DeepSeekLaunchDevelopersOctober 21, 2026

DeepSeek open-sources DeepInfer, the inference engine behind its API

Read original source →technode.com

DeepInfer runs DeepSeek-V4.1-Flash under Apache 2.0 and supports Nvidia SM100 GPUs plus Huawei Ascend 950 NPUs; DeepSeek says one cluster serves 155 trillion tokens per day. The KV cache, P/D disaggregation and load balancing are withheld, so the release covers offline inference only.

How this story unfolded

1 day · 5 reports · 4 community posts · 9 of 11 shown

  1. Oct 20
  2. Oct 21

More stories today

Open the live feed