Utility scripts for PyTorch (e.g. Memory profiler that understands more low-level allocations such as NCCL) - View it on GitHub