#temporal-consistency
Coherence across frames and time.
6 chapters, oldest era first: one idea traced across the books.
- From Frames to Worlds 2014–2015 Ch. 1: Why Video Is Hard Dimensionality, temporal coherence, and the blurry-MSE lesson that frames the whole book.
- From Frames to Worlds 2016–2019 Ch. 2: GAN Video Scene dynamics, content–motion decomposition, and DVD-GAN's attempt to scale adversarial video.
- From Frames to Worlds 2020–2025 Ch. 13: Sound and Speech Lip sync, video-to-audio, and natively audiovisual generation.
- From Frames to Worlds 2022 Ch. 5: Video Diffusion Models Factorized spatio-temporal attention, cascades, and joint image–video training.
- From Frames to Worlds 2023 Ch. 8: Image-to-Video and Motion Control Animating stills, camera trajectories, and drag-based motion control.
- From Frames to Worlds 2024 Ch. 12: Long Video and Consistency Character and scene persistence, AR–diffusion hybrids, and streaming generation.