Hopper and Blackwell GPUs train and serve models in FP8. The E4M3 format has 1 sign bit, 4 exponent bits (bias 7) and 3 mantissa bits:
m / 8 × 2⁻⁶ for m = 1…7(1 + m/8) × 2^(e − 7), except that e = 15 with m = 7 is NaN, so the largest value is 1.75 × 2⁸ = 448Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.
Start 7-day free trial