A pytorch implementation of Structured Exploration via Deep Hierarchical Coordination - View it on GitHub