Tech News
← Home  ·  All topics

Gguf Models

2 GoKawiil briefs on this topic · RSS for gguf models

PS5LM lets jailbroken PlayStation 5 consoles run GGUF models via llama.cpp

A new project called PS5LM runs llama.cpp on a jailbroken PS5's GPU, loading GGUF language models and serving them to other devices on the same network, such as laptops and phones. It exposes OpenAI-style and Anthropic-style endpoints, works with tools like Claude Code, and can also run decision models that answer TypeSafe's /v1/systemone API, the same interface used by the PC tool Ollaya. The console uses its Vulkan backend on its RDNA 2 GPU, with 11.4 GB of shared memory available for models and context, and needs no PC, cloud connection or account to operate.

Developer releases Janus, a Go binary for running GGUF models via Vulkan

A developer has published Janus, an open-source single Go binary that runs local .gguf language models on AMD, Intel or Nvidia GPUs via Vulkan, or on CPU, without requiring Python, Docker or Ollama. It exposes an OpenAI-compatible API alongside a built-in web UI with chat, tool-calling, memory and file-handling features, and supports hot-swapping models without restarting.