LLM training How to train LLMs well? Deduplicate training data: Lee2022deduplicating Alignment Zhou2023lima: you may not need many for Instruction tuning. 1,000 carefully curated prompts and responses may suffice.