GigaToken: ~1000x faster Language model tokenization
(news.ycombinator.com)
1.
2.
AI companies charge you 60% more based on your language, BPE tokens
(news.ycombinator.com)