LaunchDevelopers
1 day ago
vLLM adds streaming parser for Qwen3 in nightly
The new parser fixes Qwen3.6-27b stopping mid-turn and failing streaming tool calls due to chunk boundaries. It's available in vLLM nightly.
The new parser fixes Qwen3.6-27b stopping mid-turn and failing streaming tool calls due to chunk boundaries. It's available in vLLM nightly.