Developer Builds 380KB Language Model That Runs on MS-DOS Floppy Disk
A developer created a tiny transformer-based language model with about 367,000 parameters, small enough to fit on a single floppy disk and run under MS-DOS using Turbo C 2.0. The model, trained on roughly 3,500 facts, needs only 540KB of memory to operate and was reportedly built and trained with help from Anthropic's AI tools. Its answers are often wrong or nonsensical, such as miscalculating simple multiplication or inventing a fictional 'king of France.'