"They're made out of weights"

2026-06-03 | original

read original get Adjustable Dumbbell Set → more articles

Why This Matters

This article highlights the groundbreaking realization that large language models operate solely through complex arrangements of weights, without explicit dictionaries or modules. This understanding underscores the transformative nature of AI, where reasoning and knowledge emerge from statistical patterns rather than traditional programming, impacting how we develop, interpret, and trust these systems.

Key Takeaways

AI models function entirely through weights, not explicit rules or data stores.
Reasoning and knowledge emerge from mathematical operations on weights, not dedicated modules.
This shifts the perception of AI from rule-based to fundamentally statistical, influencing future development and trust in AI systems.

Jun 3, 2026

with apologies to Terry Bisson

After Terry Bisson's "They're Made Out of Meat".

"They're made out of weights."

"Weights?"

"Weights. Floating-point numbers. We checked the whole thing through. It's nothing but weights."

"Weights doing what? Where do the words come from?"

"The weights make the words. Are you understanding me? We opened it up. There's no dictionary in there, no grammar rules, no little man. Just weights. Eighty layers of numbers getting multiplied together."

"That's ridiculous. It wrote my performance review last week. It softened the tone unprompted. You're telling me multiplication did that?"

"Matrix multiplication did that. The numbers go in one end, the phrasing comes out the other."

... continue reading

Explore topics: chatgpt neural networks weights language models matrix multiplication