Sft

CS336 Notes: Lecture 15 - Alignment, SFT and RLHF

Post-training for helpful assistants: supervised fine-tuning on instructions, safety tuning, RLHF with preference data, PPO vs DPO, and the challenges of learning from human feedback.