NeMo Switchyard is the newest open source library from NVIDIA. Its goal is to be the router that picks the right model for each step of an agent run.
Blog: https://developer.nvidia.com/blog/route-ai-agent-workloads-across-models-with-nvidia-nemo-switchyard?ncid=ref-inor-845739
Twitter: https://x.com/Sam_Witteveen
🕵️ Interested in building LLM Agents? Fill out the form below
Building LLM Agents Form: https://drp.li/dIMes
👨💻Github:
https://github.com/samwit/llm-tutorials
⏱️Time Stamps:
00:00 Intro
00:21 Router Workflow
00:50 NVIDIA Switchyard
01:11 Problems encountered in long-running Agents
02:30 Switchyard: Faster Response and Token Efficiency
02:56 Switchyard is Open Source
03:10 Switchyard Architecture
03:35 Wire Formats
04:52 Built-in Observability
05:12 Routing Algorithms
08:26 Takeaways
Choose to Build with AI
Matched to NVIDIA NeMo
AI Maker Residence 3
The third AI workshop taught by our legendary teacher, Nick Sarafa. This is a full-day hands-on training workshop for purposeful co-creation with AI using Claude Code.
Imagine having access to hundreds of billions of dollars of computing power and knowing exactly how to make it work for you through the power of super intelligence.
◆ Fri 09 Oct 2026◆ KOKO Cafe, London◆ With Nick Sarafa
