[AAAI'25 Oral] Are Expressive Models Truly Necessary for Offline RL? - View it on GitHub