An implementation of training for GPT2, supports TPUs - View it on GitHub