Your PS5 Can Now Run Open Models (And It's Surprisingly Fast)

Item: Your PS5 Can Now Run Open Models (And It's Surprisingly Fast)
Rating: 4
Author: PostSingularity Institute

Title history

Your PS5 Can Now Run Open Models (And It's Surprisingly Fast) — observed on 20261031-2302 UTC (YouTube)

by Kai · View the channel on PSI

Applied Sciences & Engineering AI — Models & Research UYQArtificial intelligence (AI)UYQFGenerative artificial intelligence

🎙 Kai 👥 65K 📅 October 26, 2026 ⏱ 23 min 👁 22K 📄 expert opinion 🧭 2026-10-31

Available in: English (current) Français

Keywords

PS5Local AIQwen 3.8llama.cppmemory bandwidth

Summary

This video analyzes the claim that a jailbroken PS5 can run a 27B parameter LLM at 20 tokens per second. The creator explains that this writing speed is real because of the PS5’s high memory bandwidth of 448 GB/s, surpassing even some dedicated AI hardware. However, the reading speed (prefill) is only 35-50 tokens/s due to driver limitations and a GPU watchdog timer, making it unsuitable for coding agents that require large context processing. Comparisons with an RTX 5060 Ti 16GB, which has the same bandwidth but 15x faster reading, and with the same PS5 running Linux (200 tokens/s reading), highlight that the bottleneck is software, not hardware. The video also covers the cost: jailbreaking requires specific firmware, loses PSN access, and must be re-run after each reboot. Practical advice includes using smaller models like Gemma 4B or Llama 3.2 3B for responsive performance, and considering the AMD BC-250 mining board as an alternative. The conclusion: the PS5 is a private AI server for zero extra cost only if you already own one on old firmware, not a purchase recommendation.

180 words

Critical Evaluation

Value of the Information & Strength of the Argument

The video provides a solid, evidence-based analysis. It correctly identifies the two speeds of LLM inference (decode and prefill) and explains the hardware and software reasons behind the numbers. The argument is persuasive because it uses the same project’s documentation to show both the impressive writing speed and the slow reading speed, and then contrasts it with a fair comparison (RTX 5060 Ti) and the same hardware under Linux. The creator also addresses practical costs and limitations, avoiding hype. The reasoning is clear and logical, with numbers derived from credible sources.

Scientific Rigor, Source Quality, Title Accuracy

The video cites many sources, including the GitHub repositories for PS5LM and PS5LM Plus, benchmarks, and news about jailbreak and firmware. The creator is transparent about measurements and acknowledges early development status. The title is slightly one-sided as it emphasizes speed, but the content is balanced. No contradictions with main claims; the analysis is thorough and well referenced.

164 words

Title / Content Match

The title is accurate: the PS5 can run open models and the writing speed is surprisingly fast, but the video also nuances that reading speed is slow, making the title slightly optimistic but not misleading.

Quality & Reliability

8/10

The video provides detailed benchmarks, references original sources, and clearly separates writing and reading speeds, offering a balanced critical analysis. However, some numbers are from early development and may change.

Chapters

Cited Sources

PS5LM Plus GitHub repository — The main project porting llama.cpp to PS5 with Vulkan.
PS5LM (docs, CLI and console benchmarks) — Original project and documentation including benchmarks and technical details.
Developer's r/LocalLLM post — Reddit post announcing the PS5 LM project with initial results.
Qwen3.8-27B GGUF (Unsloth) — The quantized 2-bit model used on the PS5.
Qwen3.8-Flash-Next — A larger 180B model used in multi-PS5 clustering experiments.
PS5 on Linux with llama.cpp (Red Stapler) — Video and test showing the same PS5 running Linux with much higher prefill speed.
Two-PS5 cluster — GitHub repo for running a 27B model across two PS5s over Ethernet.
RTX 5060 Ti 16GB running Qwen 3.8 27B — Blog post with benchmarks from a comparable GPU.
RTX 5060 family specs — Official Nvidia specs for the RTX 5060 Ti.
DGX Spark specs — Specs for Nvidia's DGX Spark AI computer.
Relapse jailbreak, firmware 7.00 to 13.60 — Explanation of the vulnerability used for the jailbreak.
PSN and firmware 14.10 — Report on Sony blocking PSN for old firmware.
BC-250 llama.cpp fork — Forge of llama.cpp for the BC-250 mining board.
BC-250 cluster and prices — Discussion about clustering and prices of BC-250 boards.
BC-250 specs — Specs and documentation for the AMD BC-250 board.

Concurring Sources

PS5LM Plus — Confirms the existence of the project and the initial benchmark numbers.
PS5LM — Official documentation stating that smaller models are recommended for agents.

External References

Contribution & Novelties

This video contributes a balanced and detailed analysis of running LLMs on a PS5, dispelling the hype by separating writing from reading speed. It provides concrete benchmarks and comparisons, and offers practical guidance for potential users. The originality lies in the systematic breakdown of the causes behind the performance numbers.

Pour aller plus loin :

Memory bandwidth — Key concept determining decode speed in LLM inference.
Vulkan API — Graphics API used to run GPU kernels on PS5’s RDNA2.
llama.cpp — The inference engine ported to PS5.
GGUF quantisation — The file format used for quantized models.

97 words

Radar Profile

The profile is balanced across technical depth, information quality, and reliability, with slightly lower scores for quantity due to the focused scope. The video excels in technical explanation and use of credible sources.

Reliability 8/10