A request can be escalated to a fallback model when the primary model's answer meets a configured confidence condition. Conditions can be combined; Choice and Score questions use confidence conditions, while Boolean questions use a probability range. Existing plain model-name fallbacks remain unaffected, and requests without the new conditional object retain their existing behavior. A triggered fallback runs a second decision and bills both stages. The feature is configured through an object in providerOptions.gateway.models. Source: https://prismix.dev/news/913dedb81fc2
Raw SignalOct 6, 20261 min read1 source
Your agents can now escalate uncertain decisions to a fallback model.
In one minute
Vercel AI Gateway has added beta support for confidence-conditioned decision fallbacks.