skip to content

Search
← All concepts

#alignment

Making models follow intent safely.

5 chapters, oldest era first: one idea traced across the books.

  1. From Noise to Image Cross-era Ch. 21: Evaluation, Provenance, and Safety FID's math and failure modes, human preference data, memorization and extraction, watermarking and C2PA.
  2. The Language Machines 2017–2022 Ch. 13: RLHF Bradley–Terry reward models and the PPO objective with a KL penalty — InstructGPT.
  3. The Language Machines Cross-era Ch. 22: Measuring Minds and the Frontier MMLU to HELM to Arena, contamination, benchmark saturation, and the open problems.
  4. The Language Machines 2021–2022 Ch. 12: Instruction Tuning FLAN and T0 task mixtures, and self-instruct bootstrapping.
  5. The Language Machines 2023–2024 Ch. 15: Preference Optimization Beyond PPO DPO's closed-form trick, Constitutional AI and RLAIF, and GRPO.