Diffusion Language Models

Explainer breaks down how diffusion-based language models are built

A technical walkthrough details how diffusion language models work as an alternative to the dominant autoregressive approach used by most LLMs today. Rather than generating text token-by-token in sequence, diffusion models produce an entire sequence at once and refine it over multiple steps, drawing on techniques like masking, iterative refinement, and post-training used in recent open-source models. The material stems from workshop talks and lectures given at ICLR 2026 and MLSS 2026.

kuleshov-group.github.io · 2026-08-30

Continuous diffusion language models see renewed research momentum

A wave of new research papers is reviving interest in continuous diffusion techniques for language generation, an approach that had largely been overtaken by discrete diffusion and autoregressive methods in recent years. The author reviews this resurgence, tracing why continuous diffusion for text fell out of favor and why several research groups are now revisiting it as an alternative to token-by-token autoregressive generation.

sander.ai · 2026-08-30