This repo contains the code for 1D tokenizer and generator - View it on GitHub