Field noteOct 24, 20261 min read1 source

Augment Your LiveKit Agent with Modal GPUs

In one minute

Modal published a tutorial showing how to pair LiveKit Agents with custom models hosted on Modal GPUs.

What changed: Modal published a tutorial on augmenting LiveKit agents with Modal GPUs, including open-weight and custom models.

The example builds a video avatar using BitHuman’s open-weights Expression Video Avatar and Qwen3-TTS, then connects it to a LiveKit room.

The setup uses Modal’s Server endpoint to launch the avatar container. Modal says its Sticky Sessions primitive keeps a client associated with the same container after WebSocket reconnections; the LiveKit agent starts the session, calls the /launch endpoint with its token, and ends the session when the call finishes.

Modal also says GPU snapshots hide cold starts that would otherwise require loading gigabytes of model weights. The post links to full code and describes the BitHuman integration as a self-hosted GPU container.

The source does not provide latency, throughput, reliability, pricing, or production benchmark results for this configuration. It also does not announce a new LiveKit or Modal product release.

Evidence / sources

  1. 1modal.com/blog/livekit-modal
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicGenerative MediaExplore the generative-media topic hub.
  2. 02topicMultimodalExplore the multimodal topic hub.
  3. 03archiveField NotesOpen the latest editorial analysis.
  4. 04source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract