GoKawiil
Tech News
A developer reports replicating findings from a paper titled 'Sparks of Weight-Space Programming,' which described GPT-6 Astra analyzing and editing raw neural network weights directly from text. The blogger says a locally run Qwen 3.8 27B model performed similar weight interpretation tasks on a laptop, following an example from the paper.
A critical analysis challenges a widely shared post claiming that an AI system called Astra (described as GPT-6 Astra) can improve neural networks purely by inspecting raw weights, including boosting Qwen3.5-0.8B's math performance from 7.9% to 48.1% on MATH-500. The analysis finds that only small-scale experiments, like naming what a PPO-trained network does, actually work by reading raw weights alone; the Qwen math-improvement experiment and a game-playing network experiment relied on running the network and using Python tools rather than weight inspection alone.
A research team reports that its frontier model, called Astra, can directly read and edit neural network weights without any training loop or gradient updates. By identifying a reasoning-loop flaw in Qwen3.5-0.8B's weights, Astra edited roughly 0.016% of them and raised the model's MATH-500 score from 7.9% to 48.1%, with IFEval scores tripling. Astra also reportedly wrote small game-playing networks from scratch that beat networks trained with PPO over 100 million steps, and could identify a network's training task just by inspecting its weights.