GoKawiilPS5LM lets jailbroken PlayStation 5 consoles run GGUF models via llama.cpp
A new project called PS5LM runs llama.cpp on a jailbroken PS5's GPU, loading GGUF language models and serving them to other devices on the same network, such as laptops and phones. It exposes OpenAI-style and Anthropic-style endpoints, works with tools like Claude Code, and can also run decision models that answer TypeSafe's /v1/systemone API, the same interface used by the PC tool Ollaya. The console uses its Vulkan backend on its RDNA 2 GPU, with 11.4 GB of shared memory available for models and context, and needs no PC, cloud connection or account to operate.
GoKawiil's interpretation of the reporting above, not reported fact.
The project suggests idle gaming hardware could be repurposed as a local AI inference server, appealing to hobbyists who want private, offline model hosting without buying dedicated GPUs. By mimicking established APIs from OpenAI, Anthropic and Ollaya, it could let existing developer tools and workflows plug into a PS5 with minimal changes, though this depends on users maintaining a jailbroken console.
- PS5LM runs llama.cpp on a jailbroken PS5's GPU to serve GGUF language models over a local network.
- It supports OpenAI and Anthropic-style APIs plus a browser chat interface, and works with tools like Claude Code.
- It can also run decision models answering the /v1/systemone API, the same interface used by the PC-based Ollaya tool.
PlayStation 5 Slim console — If you're going to turn your PS5 into a private home AI server, you need the console itself, and the Slim model offers a compact form factor that fits neatly under a TV. Its RDNA 2 GPU and shared memory pool are exactly what projects like PS5LM tap into for running GGUF models locally without a PC or cloud account.
See PlayStation 5 Slim console on Amazon → Affiliate link — we may earn a commission on purchases, at no extra cost to you. Product picked by AI based on this article; it is not a tested recommendation.Source: github.com, 2026-10-16
Published there as: “Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console”
Read the original report → The summary and analysis above are GoKawiil's own, written from reporting by the source above. Facts and quotes belong to the original publisher.