TokenGeeX is a tokenizer for CodeGeeX aimed at code and Chinese - View it on GitHub