GoKawiilIndependent researcher trains small transformer to 44% on ARC-AGI-1 for 67 cents
A researcher built and trained a small transformer model from scratch in 1.5 hours on a single RTX 5090 GPU, achieving 44% accuracy on the ARC-AGI-1 public evaluation set and 7% on ARC-AGI-2. The model, an upgraded and cheaper version of a previous open-source release, matches the performance of existing test-time-training approaches like TRM and HRM while using far less compute.