Together AI explains capacity-aware routing in Dedicated Model Inference

Together AI's dedicated inference splits into three parts: endpoints (stable call names), deployments (model+hardware replicas), and immutable configs (engine, GPU, parallelism), tied together by a capacity-aware traffic split. This enables A/B tests, shadow experiments, and zero-downtime rollouts via simple traffic weights.