Gitstar Ranking
Users
Organizations
Repositories
Rankings
Users
Organizations
Repositories
Sign in with GitHub
niieani
Fetched on 2025/03/15 08:06
niieani
/
gpt-tokenizer
The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT-2 / GPT-3 / GPT-4 / GPT-4o / GPT-o1. Port of OpenAI's tiktoken with additional features. -
View it on GitHub
https://gpt-tokenizer.dev
Star
531
Rank
67537