AnalysisDevelopersNovember 9, 2026

Talk argues self-hosted LLM inference needs admission control

Read original source →youtube.com

Harshul Jain and Parv Khatri of Audible and SAP argue self-hosted inference layers accept every request from fanning-out coding agents, burying priority work before it reaches the GPU. They propose admission control: deciding what to refuse up front.

1 source

More stories today

Open the live feed