NVIDIA Dynamo preview adds shadow engine recovery for fast LLM failover
NVIDIA Dynamo's shadow engine recovery, now in preview, cuts LLM inference failover from 283 seconds to 7.3 seconds in a GLM-5.2 test. It keeps an idle initialized engine sharing weights via GPU Memory Service, so recovery happens off the serving path.
1 source
NVIDIA by email
Get an email when NVIDIA has news
No news that day, no email.
More stories today
- GLM and Qwen top preliminary Agent Arena Code results
- Hugging Face offers free Robotics Course
- Lightspeed predicts globally competitive Indian AI model by 2027
- AWS Quick and fal enable agentic creative workflows
- Anthropic opens 10,000 free Claude seats for scientists