Raw SignalSep 23, 20261 min read1 source

Taming the ML Firehose: Scaling Feature Consistency

In one minute

Uber describes a feature-logging framework that records the exact feature values consumed during online inference and makes those records the canonical source for subsequent model training.

The aim is to reduce training-serving inconsistency caused by separate online and offline computation paths.

At reported peak prediction traffic of 8 million QPS, logging every prediction would create hundreds of billions of records per day, with an estimated 1.7 PB daily footprint. Uber therefore logs allow-listed model features, aliases verbose names to integer IDs, and joins prediction logs with client impression events in Flink so that training records retain predictions actually seen by users. The company says the allow list cuts payload size by 4–5×.

Evidence / sources

  1. 1uber.com/us/en/blog/taming-ml-firehose
All Raw Signals

Next reads

Read next

Open the graph
  1. 01archiveRaw SignalsOpen every source-linked raw signal.
  2. 02source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract