Tech News
← Home  ·  All topics

Webgpu

14 GoKawiil briefs on this topic

WebLLM brings OpenAI-compatible LLM inference directly into web browsers via WebGPU

WebLLM is an open-source engine that runs large language models entirely inside a web browser, using WebGPU for hardware acceleration instead of relying on a server. It offers full compatibility with the OpenAI API, including streaming, JSON-mode structured output, and support for models like Llama 3, Phi 3, Gemma, Mistral, and Qwen. Developers can install it as an npm package and build applications on top of it, or integrate custom models in MLC format.

Pngine: New S-Expression Format Turns WebGPU Code Into Runnable PNG Files

An independent developer has released pngine, a declarative language and runtime built over 2.5 years that lets programmers describe WebGPU shaders and pipelines using S-expressions mirroring the WebGPU spec directly. The tool validates configurations via WGSL reflection without needing a live GPU context, offers an LSP for real-time error checking, and can export projects as a single HTML file, a ZIP, or even a self-contained PNG image holding compiled bytecode.