ThunderAgent: 2x faster agentic inference

ThunderAgent is a program-aware scheduler for agentic inference, accepted to ICML 2026 as a Spotlight paper. It delivers 2x single-node throughput and near-linear multi-node scaling by eliminating KV cache thrashing.