Show HN: Quicktok, an exact BPE tokenizer 7x faster than tiktoken
By dmatth1 · 2026-07-03 · 2 points · 1 comments
https://github.com/dmatth1/quicktok
By dmatth1 · 2 points · 1 comments · on Hacker News, read on BetterNews.
Open the full discussion on BetterNews