Tech News
← Home  ·  All topics

Residual Stream

1 GoKawiil brief on this topic · RSS for residual stream

Researcher maps Qwen3-1.7B's internal representations across conversations

A developer built an interactive atlas visualizing the internal vector states of the Qwen3-1.7B language model as it processes conversations. The project tracked 2,048-dimensional vectors from the model's residual stream across roughly 100 topics, using question-and-answer examples in English, Chinese, German, and Croatian plus coding examples, to see how similar ideas and languages cluster in vector space.