Open-AI's DALL-E for large scale training in mesh-tensorflow. - View it on GitHub