skip to content

Search
← All concepts

#in-context-learning

Learning from the prompt without weight updates.

2 chapters, oldest era first: one idea traced across the books.

  1. The Language Machines 2018–2020 Ch. 7: The GPT Lineage Decoder-only scaling from GPT-1 to GPT-3, and in-context learning as an emergent phenomenon.
  2. The Language Machines 2022–2023 Ch. 19: Prompting Becomes Reasoning Chain-of-thought, self-consistency, and tree search over thoughts.