How-ToDevelopersOctober 3, 2026

Nebius engineers detail serving open LLMs fast in production

Read original source →youtube.com

Nebius Token Factory's Dylan Bristot and developer advocate Sujee Maniyam walk through the trade-offs of running open LLMs in production, noting open models have nearly caught up with proprietary ones while fast, cheap serving remains the hard part.

People · Sujee Maniyam, Dylan Bristot

1 source

More stories today

Open the live feed