KV Cache-Aware Routing and P/D Disaggregation on Kubernetes — Yuchen Fama & Ashish Kamra, Red Hat
At the AI Engineer conference, Red Hat's Yuchen Fama (vLLM contributor and product manager) and Ashish Kamra (senior manager of perfo...









