GoKawiilPS5LM lets jailbroken PlayStation 5 consoles run GGUF models via llama.cpp
A new project called PS5LM runs llama.cpp on a jailbroken PS5's GPU, loading GGUF language models and serving them to other devices on the same network, such as laptops and phones. It exposes OpenAI-style and Anthropic-style endpoints, works with tools like Claude Code, and can also run decision models that answer TypeSafe's /v1/systemone API, the same interface used by the PC tool Ollaya. The console uses its Vulkan backend on its RDNA 2 GPU, with 11.4 GB of shared memory available for models and context, and needs no PC, cloud connection or account to operate.