NVIDIA Dynamo previews shadow engine recovery for fast LLM failover
NVIDIA Dynamo's shadow engine recovery, now in preview, cuts LLM inference failover from 283 seconds to 7.3 seconds in a GLM-5.2 test. It keeps an idle initialized engine sharing weights via GPU Memory Service, so recovery happens off the serving path.
1 source
NVIDIA by email
Get an email when NVIDIA has news
No news that day, no email.
More stories today
- Liquid AI open-sources Pipette benchmarking suite for on-device models
- wikiHow sues OpenAI over copyright infringement in AI training
- Claude Code 2.1.246 adds Auto mode tab, Bash wildcard warning
- Korean AI startup Wrtn raises funds at $870M valuation
- Podcast: Google DeepMind's Vivek Natarajan on AI in healthcare