Raw SignalOct 9, 20261 min read1 source

Baseten published a technical explainer on selecting layer precision for NVFP4 quantization

In one minute

Baseten published a technical explainer on selecting layer precision for NVFP4 quantization.

It describes activation calibration, block scaling over groups of 16 values, architecture-based heuristics, and sensitivity scoring for mixed-precision recipes. Its central warning is that isolated-layer sensitivity scores are not additive: the loss contribution of quantizing a layer depends on what else has already been quantized. The post describes SaturationQuant, using Aumann–Shapley scoring, as a way to incorporate saturation so scores can be summed to estimate a recipe's loss more accurately. This is a vendor-authored technical explanation, not independent validation of comparative performance.

Evidence / sources

  1. 1baseten.co/blog/what-makes-a-high-quality-nvfp4-quantization
All Raw Signals

Next reads

Read next

Open the graph
  1. 01archiveRaw SignalsOpen every source-linked raw signal.
  2. 02source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract