Skip to content
Tech News
clear
Topics: Today This Week This Month This Year

Developer open-sources Mini-AGI, a self-growing language model trained on 8GB VRAM

A hobbyist project called Mini-AGI has been shared on Hacker News as a byte-level language model that builds its own architecture and trains from scratch on a single consumer GPU with 8GB of VRAM. Rather than keeping all parameters in memory, it stores weights as disk files and loads them as needed, letting it expand or prune capacity while it continuously reads and learns from a text corpus without forgetting prior knowledge. The creator says it's currently a toy-scale demonstration, not a competitive model, and weights won't be released until the current training pass over its corpus finishes in a few weeks.

Today's top topics: made on youtube youtube artificial intelligence openai fast company best dressed in business qualcomm snapdragon 8 elite gen 6 android authority amazon deal
View all today's topics →