Serverless reinforcement learning framework for LLMs on Modal with pluggable rewards, TRL algorithms, and vLLM-powered rollouts. - View it on GitHub