Attention Decode on AMD MI450 GPUs: A Gluon Kernel Optimization Guide
(news.ycombinator.com)
1.
2.
I made a kernel 2.2x faster. It made my training loop 3x slower
(news.ycombinator.com)