Raw SignalOct 21, 20261 min read1 source

Serverless routing made sticky

In one minute

Modal announced Sticky Sessions for its serverless compute, adding session-level routing that directs every request in a session to the same container.

What changed: Modal launched Sticky Sessions for serverless workloads that need requests routed to the same container; prior coverage concerned NVIDIA Dynamo’s session-aware inference routing.

The company says the feature is intended for workloads that need continuity across reconnects, including voice agents, streaming speech-to-text, stateful web UIs, and multiplayer games.

The mechanism differs from request-level routing and the best-effort affinity previously available through Modal Servers. Session tokens carry routing metadata, while the container host tracks session lifecycle. Autoscaling uses active sessions and queued demand as inputs; containers can be configured to handle one or more concurrent sessions, and new sessions may queue when capacity is exhausted.

This is a product capability release, not evidence of a general guarantee that application state survives container replacement. Modal’s post describes routing, authorization, load balancing, and scaling design, but does not provide independent performance or reliability measurements. Source: https://modal.com/blog/serverless-routing-made-sticky

Evidence / sources

  1. 1modal.com/blog/serverless-routing-made-sticky
All Raw Signals

Next reads

Read next

Open the graph
  1. 01archiveRaw SignalsOpen every source-linked raw signal.
  2. 02source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract