Engineering voice agents: Latency, quality, and scale — Rishabh Bhargava, Together AI

Rishabh Bhargava from Together AI discusses latency thresholds for voice agents, noting users notice latency above 500ms and hang up above one second. He explains that colocating models in the same building reduces network latency from 75ms to 5ms.