Developer open-sources Mini-AGI, a self-growing language model trained on 8GB VRAM
A hobbyist project called Mini-AGI has been shared on Hacker News as a byte-level language model that builds its own architecture and trains from scratch on a single consumer GPU with 8GB of VRAM. Rather than keeping all parameters in memory, it stores weights as disk files and loads them as needed, letting it expand or prune capacity while it continuously reads and learns from a text corpus without forgetting prior knowledge. The creator says it's currently a toy-scale demonstration, not a competitive model, and weights won't be released until the current training pass over its corpus finishes in a few weeks.