GoKawiilReddit developer ports llama.cpp to run natively on jailbroken PS5 GPU
A Reddit user known as AdIllustrious7246 built a fork of PS5LM, a llama.cpp port for jailbroken PS5 consoles, that uses the PS5_Vulkan graphics driver to run AI language models on the console's GPU instead of its CPU. The update lets the PS5 run a 27-billion-parameter model at 20 tokens per second, and smaller models like Gemma 4 E4B and Llama 3.2 3B at 61 and 124 tokens per second respectively, far faster than the earlier CPU-only version that was limited to about 6.25 GiB of memory.