Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch - View it on GitHub