{"type":"post","stable_id":"post:nvidia-switchyard-makes-model-routing-a-runtime-decision","slug":"nvidia-switchyard-makes-model-routing-a-runtime-decision","title":"NVIDIA Switchyard Makes Model Routing a Runtime Decision","description":"NVIDIA NeMo released Switchyard, an experimental proxy and Rust library that routes LLM traffic across providers while preserving OpenAI and Anthropic API shapes.","retrieval_nugget":"The meaningful unit is no longer a model selected once at startup. Routing policy can react to stage signals, errors, latency, or an explicit classifier while the client keeps one native protocol. Switchyard is pre-alpha and should be treated as an architecture probe, not production infrastructure.","published_at":"2026-08-14","updated_at":"2026-08-15","record_date":"2026-08-14","date_kind":"discovered_at","topics":["routing","orchestration","coding-agents"],"entities":["NVIDIA NeMo","Switchyard"],"source_urls":["https://github.com/NVIDIA-NeMo/Switchyard","https://venturebeat.com/orchestration/nvidias-switchyard-router-reshuffles-ai-models-mid-task-cutting-task-costs-to-a-third-in-its-own-tests"],"source_format":"github","editorial_timing":{"lane":"regular_hourly","scheduled_at":"2026-08-18T12:00:00+03:00","real_news_delta":"owner-selected verified story"},"origin":{"basket_id":"5854f7b2-5954-4d2a-8997-81596a49da74","basket_revision":1,"target_kind":"story_cluster","target_id":"a25ca672-3cda-4cf2-b84f-f6ee8bfab2b3","owner_selection":"1","route":"hermes"},"visual_decision":{"outcome":"generate_explanatory_diagram","status":"included","reason_code":"architecture_or_boundary","explanatory_value":"switchyard routes one native client protocol through explicit routing policy to different model backends","text_only_limitation":"A paragraph cannot show protocol translation, routing policy, backend choice, and returned response as one bounded path as clearly as a compact architecture diagram.","owner_reviewed":true,"reviewed_by":"owner-and-codex"},"schema_version":"newruntime-agent-readable-v0.2","status":"published","visuals":[{"role":"hero","src":"/images/drip/nvidia-switchyard-makes-model-routing-a-runtime-decision/nvidia-switchyard-makes-model-routing-a-runtime-decision.webp","alt":"New Runtime whiteboard diagram explaining nvidia switchyard makes model routing a runtime decision.","caption":"New Runtime synthesis from github.com."}],"routes":{"html":"https://newruntime.com/posts/nvidia-switchyard-makes-model-routing-a-runtime-decision/","markdown":"https://newruntime.com/posts/nvidia-switchyard-makes-model-routing-a-runtime-decision.md","json":"https://newruntime.com/posts/nvidia-switchyard-makes-model-routing-a-runtime-decision.json"}}