LeanRL is a fork of CleanRL, where selected PyTorch scripts optimized for performance using compile and cudagraphs. - View it on GitHub