An implementation of Phasic Policy Gradient, a proposed improvement of Proximal Policy Gradients, in Pytorch - View it on GitHub