Author's PyTorch implementation of BCQ for continuous and discrete actions - View it on GitHub