#conditioning
Steering generation with signals (text, pose, depth, guidance).
6 chapters, oldest era first: one idea traced across the books.
- From Noise to Image 2015–2018 Ch. 7: First Words to Pictures Text conditioning before diffusion: StackGAN, AttnGAN, and attention over words.
- From Noise to Image 2021–2022 Ch. 10: Guidance Classifier guidance, the classifier-free guidance formula, and the dial between fidelity and diversity.
- From Noise to Image 2021–2023 Ch. 17: Editing SDEdit, attention-map surgery, instruction-based editing, and inpainting.
- From Noise to Image 2023 Ch. 15: Control ControlNet's zero-convolution trick, adapters, and reference images — from prompting to specification.
- From Frames to Worlds 2023 Ch. 7: Video-to-Video and Editing Structure-preserving synthesis — Runway's Gen-1 becomes a product before the model race begins.
- From Frames to Worlds 2023 Ch. 8: Image-to-Video and Motion Control Animating stills, camera trajectories, and drag-based motion control.