Supplemental materials for "Playing FPS Games with Environment-Aware Hierarchical Reinforcement Learning", accepted by IJCAI'19 - View it on GitHub