skip to content

Search

← All concepts

#instruction-tuning

Supervised fine-tuning on instruction–response data.

2 chapters, oldest era first: one idea traced across the books.

  1. The Language Machines 2021–2022 Ch. 12: Instruction Tuning FLAN and T0 task mixtures, and self-instruct bootstrapping.
  2. The Language Machines 2022–2023 Ch. 14: ChatGPT and the Open Explosion The product moment, then the LLaMA leak, Alpaca, Llama 2, and Mistral.