Understanding FlashAttention Pt 1: Personal Notes
(news.ycombinator.com)
1.
2.
TokenTown: A visual way to understand how LLMs work
(news.ycombinator.com)
3.
The annotated PyTorch training loop
(news.ycombinator.com)
4.
Softmax, can you derive the Jacobian? And should you care?
(news.ycombinator.com)