They’re made out of weights

2026-06-03 | original

read original get Adjustable Dumbbell Set → more articles

Why This Matters

This article highlights that modern AI language models operate solely based on complex weights within neural networks, rather than explicit dictionaries or modules. This understanding underscores the transformative nature of AI, where reasoning and knowledge emerge from statistical patterns rather than traditional programming, impacting how we develop, interpret, and trust these systems.

Key Takeaways

AI models are driven entirely by weights in neural networks, not explicit rules or databases.
Reasoning and knowledge are emergent properties of weight configurations, not separate modules.
This shifts the perception of AI from rule-based systems to complex, weight-based pattern recognition.

Jun 3, 2026

with apologies to Terry Bisson

After Terry Bisson's "They're Made Out of Meat".

"They're made out of weights."

"Weights?"

"Weights. Floating-point numbers. We checked the whole thing through. It's nothing but weights."

"Weights doing what? Where do the words come from?"

"The weights make the words. Are you understanding me? We opened it up. There's no dictionary in there, no grammar rules, no little man. Just weights. Eighty layers of numbers getting multiplied together."

"That's ridiculous. It wrote my performance review last week. It softened the tone unprompted. You're telling me multiplication did that?"

"Matrix multiplication did that. The numbers go in one end, the phrasing comes out the other."

... continue reading

Explore topics: chatgpt weights linear algebra language models matrix multiplication