Attention Is All You Need

Interactive Explainer Breaks Down GPT-2's Transformer Architecture Visually

A visual explainer tool called Transformer Explainer illustrates how Transformer-based neural networks work, using the 124-million-parameter GPT-2 (small) model as its example. It walks through core components like tokenization, embeddings, attention mechanisms, and Transformer blocks to show how these models predict the next word in a sequence.

poloclub.github.io · 2026-09-21

Cohere CEO Aidan Gomez: China's AI gains go beyond model distillation

Cohere CEO Aidan Gomez said Chinese AI labs have built genuine capabilities that surpass simple copying of American models, even as U.S. companies and officials frame Chinese progress largely as 'distillation' or theft. He noted that some Chinese models now beat top American systems on certain benchmarks, which he argues wouldn't be possible through distillation alone since that technique can only narrow a gap, not exceed it.

cnbc.com · 2026-09-18