skip to content

Search

← All concepts

#mixed-precision

FP16/BF16/FP8 numerics.

1 chapter, oldest era first: one idea traced across the books.

  1. The Engine Room 2017–2024 Ch. 7: Mixed Precision FP32, FP16, BF16, FP8 and loss scaling: halving the bytes doubles the model.