Ifeval - GoKawiil

Report disputes claims that 'Astra' AI reads raw weights to improve Qwen model

A critical analysis challenges a widely shared post claiming that an AI system called Astra (described as GPT-6 Astra) can improve neural networks purely by inspecting raw weights, including boosting Qwen3.5-0.8B's math performance from 7.9% to 48.1% on MATH-500. The analysis finds that only small-scale experiments, like naming what a PPO-trained network does, actually work by reading raw weights alone; the Qwen math-improvement experiment and a game-playing network experiment relied on running the network and using Python tools rather than weight inspection alone.

honnibal.dev · 2026-11-03

Astra AI system edits Qwen3.5-0.8B's raw weights, lifting MATH-500 score sixfold

A research team reports that its frontier model, called Astra, can directly read and edit neural network weights without any training loop or gradient updates. By identifying a reasoning-loop flaw in Qwen3.5-0.8B's weights, Astra edited roughly 0.016% of them and raised the model's MATH-500 score from 7.9% to 48.1%, with IFEval scores tripling. Astra also reportedly wrote small game-playing networks from scratch that beat networks trained with PPO over 100 million steps, and could identify a network's training task just by inspecting its weights.

rikiyat.github.io · 2026-11-02