Red Hat engineers discuss KV cache-aware routing and P/D disaggregation on Kubernetes
Read original source →youtube.com
Yuchen Fama and Ashish Kamra of Red Hat present KV cache-aware routing and P/D disaggregation for Kubernetes. Agentic sessions in Red Hat's traces run from a few turns to 3,000, with cache hit rates routinely above 90% and input-to-output token ratios often exceeding 100:1.
People · Yuchen Fama, Ashish Kamra
1 source
More stories today
OpenAI math problems turned into open-source RL environments on Hugging Face
Clem Delangue·2 hours ago
AI Buildout Borrowing Reshapes Corporate Bond Market
Hyperscalers, data centers and chip companies are borrowing hundreds of billions of dollars to finance the AI buildout, making the tech boom one of the biggest new forces in corporate credit. Investors keep buying, but concentration and complex data-center financing are raising concerns.
Bloomberg Technology·2 hours ago

Akamai engineers: speculative decoding cut demo model to 16 tok/s
Akamai's Du'an Lightfoot and Khaja Omer cite a speculative decoding run that dropped a demo model from roughly 58 tokens per second to 16 instead of speeding it up. Their point: inference configs must be measured against the actual model, hardware and workload.
YouTube·2 hours ago
Execs say voice AI still lacks its ChatGPT moment
PolyAI CTO Shawn Wen says full-duplex models exist but reasoning speed is the next hurdle for natural conversation. Otter CMO Alex Gay points to speaker identification and intent capture as key to automation.
TechCrunch·2 hours ago

Claude Code found an app's shared contract in two MCP calls
A developer reports Claude Code rediscovered a system's architecture — which service owns the data, which frontend calls it, which shared type they use — in two MCP calls. The records then ran out, cutting the session short.
The New Stack·2 hours ago

AI reverse-engineering ports GTA 5, MW2, Halo to browsers
AI reverse-engineering tools let vibe coders recompile AAA games for the browser, with GTA 5's open-world sandbox and story mode playable free with no download. Activision, Bethesda and Rockstar have issued DMCA takedowns, but copycats keep hosting ports on .dev, .lol, .gg and .io domains.
r/Singularity·2 hours ago
LangChain's Harrison Chase questions agent identity model
Harrison Chase·3 hours agoCommentary: selling agents as a service beats one-person agent companies
Vaibhav Sisinty·3 hours ago