Descriptions:
NeMo Switchyard is the newest open source library from NVIDIA. Its goal is to be the router that picks the right model for each step of an agent run.
Blog: https://developer.nvidia.com/blog/route-ai-agent-workloads-across-models-with-nvidia-nemo-switchyard?ncid=ref-inor-845739
Twitter: https://x.com/Sam_Witteveen
🕵️ Interested in building LLM Agents? Fill out the form below
Building LLM Agents Form: https://drp.li/dIMes
👨💻Github:
https://github.com/samwit/llm-tutorials
⏱️Time Stamps:
00:00 Intro
00:21 Router Workflow
00:50 NVIDIA Switchyard
01:11 Problems encountered in long-running Agents
02:30 Switchyard: Faster Response and Token Efficiency
02:56 Switchyard is Open Source
03:10 Switchyard Architecture
03:35 Wire Formats
04:52 Built-in Observability
05:12 Routing Algorithms
08:26 Takeaways
