Go BPE tokenizer (Encoder+Decoder) for GPT2 and GPT3 support multibyte characters - View it on GitHub
Star
1
Rank
4891825