Training large language models with reinforcement learning

Reinforcement learning, LLMs, Reward model, Reinforcement learning from human feedback

Examples

• InstructGPT
• https://you.com

Libraries

• Transformer Reinforcement Learning: https://github.com/CarperAI/trlx

Studies

• Ramamurthy2022reinforcement
• Wang2022Self Instruct