Don't trust large context windows
(news.ycombinator.com)
1.
2.
High-Fidelity KV Cache Summarization Using Entropy and Low-Rank Reconstruction
(news.ycombinator.com)