NVIDIA Dynamo adds shadow engine recovery for fast LLM failover
NVIDIA Dynamo's preview shadow engine recovery cuts LLM engine failover from 283 seconds to 7.3 seconds in a two-worker GLM-5.2 deployment, nearly 39x faster. It keeps an idle shadow engine sharing weights via GPU Memory Service, re-initializing off the serving path.
1 source
NVIDIA by email
Get an email when NVIDIA has news
No news that day, no email.
More stories today
- Agentic Cloud concept introduced
- OpenAI's Codex client reveals GenUI interface platform
- Weaviate 1.39 adds Boost API, MMR, 4-bit quantization
- JPMorgan leads $5B debt package for Volta AI data centers
- Vercel Chat SDK adds Claude Managed Agents and Notion adapter