Microgpt in pure C hits 10M tps on Apple m5
(news.ycombinator.com)
1.
2.
GateGPT: 56k tokens per second Transformer (KV cache) on FPGA at 80 MHz
(news.ycombinator.com)