gpt-tokenizer
✅ Recently maintainedThe fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
857Stars
66Forks
07-day stars
TypeScript · MIT · Last push 2026-10-18
Official repository & installation ↗GitValue · Value evidence
Unscored · Evidence coverage 0%
Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.
Star history
2025-09-292026-11-02
View historical data
| Date | Stars |
|---|---|
| 2026-10-04 | 851 |
| 2026-10-05 | 851 |
| 2026-10-06 | 851 |
| 2026-10-07 | 852 |
| 2026-10-08 | 852 |
| 2026-10-09 | 852 |
| 2026-10-10 | 853 |
| 2026-10-11 | 854 |
| 2026-10-12 | 854 |
| 2026-10-13 | 854 |
| 2026-10-14 | 854 |
| 2026-10-15 | 854 |
| 2026-10-16 | 855 |
| 2026-10-17 | 855 |
| 2026-10-18 | 855 |
| 2026-10-19 | 855 |
| 2026-10-20 | 855 |
| 2026-10-21 | 856 |
| 2026-10-22 | 856 |
| 2026-10-23 | 856 |
| 2026-10-24 | 856 |
| 2026-10-25 | 857 |
| 2026-10-26 | 857 |
| 2026-10-27 | 857 |
| 2026-10-28 | 857 |
| 2026-10-29 | 857 |
| 2026-10-30 | 857 |
| 2026-10-31 | 857 |
| 2026-11-01 | 857 |
| 2026-11-02 | 857 |
Get the project
git clone https://github.com/niieani/gpt-tokenizer.gitCloning downloads the source. For dependencies and installation, follow the project README.
Related projects & alternative candidates
Related domains do not imply feature parity. Review official documentation and licenses.