Implementation of the Llama architecture with RLHF + Q-learning - View it on GitHub