Architectures - GoKawiil

OpenArch open-sources readable PyTorch rewrites of major LLM architectures

A new open-source repository called OpenArch offers hand-written PyTorch implementations of prominent LLM architectures, including GPT-2 XL, Llama 2, Llama 3, OLMo 2, DeepSeek R1 and Gemma 3. Each model is coded from scratch based on original papers, technical reports and config files, with one clear, self-contained file per architecture rather than production-optimized code.

github.com · 2026-09-14

Advice column urges teens to master LLM fundamentals from first principles

An opinion piece argues that a 17-year-old today should focus on building large language models from scratch rather than just using them, in order to understand their capabilities and limits. The author notes LLMs excel at tasks like writing essays but fail at physical, real-world tasks like cleaning a room, and suggests pursuing college and graduate study aimed at closing that gap. The piece frames this as a path toward developing new architectures beyond current LLMs for physical-world learning.

twitter.com · 2026-08-23