Developer pushes Qwen3.8-27B to 2,000 prefill tps on RTX 3090

A custom inference engine for Qwen3.8-27B now hits 2,000 prefill tokens/sec and 132 decode tokens/sec on a single power-limited RTX 3090. The same build reached 381 tps single-request earlier, up from 82 tps in the initial release.
1 source
More stories today
AMD-backed Korean AI startup Upstage weighs pre-IPO round
Upstage, a South Korean AI startup backed by AMD, is considering a pre-listing funding round among several capital-market options, per co-founder comments to Bloomberg. No round size, valuation, or timeline was disclosed.
Bloomberg Technology·3 hours ago
Reddit users discuss tasks they stopped using Claude for
r/ClaudeAI thread asks what people tried Claude on, decided wasn't worth the round trip, and went back to doing by hand. No specific model version, benchmark, or product change is cited.
r/ClaudeAI·4 hours agoEmily Bender critiques pro-AI science communication and OpenAI math claims
Emily M. Bender·4 hours agoAlibaba to lead $300M round in UniPat AI at $2.5B valuation
Alibaba Group is slated to lead a $300 million investment in AI training and benchmarking startup UniPat AI, valuing it at $2.5 billion. The company was founded by a former Alibaba intern.
Bloomberg Technology·4 hours ago
Kimi K3 tops Fable 5.1 by 60% on Harvey Lab-AA legal tasks
Together AI·4 hours ago
Shield AI co-founder discusses APAC expansion plans
Shield AI co-founder and president Brandon Tseng outlined the defense startup's growth strategy and expansion into APAC markets in a Bloomberg: The Asia Trade interview.
Bloomberg Technology·4 hours ago
Independent researcher releases audio model for text-to-synth generation
The model generates infinite one-shots for music production and turns text prompts into fully playable synths, treating timbre as a separately controllable attribute. The release includes the model weights, an inferencing pipeline, and a video walkthrough of the training process.
r/LocalLLaMA·4 hours ago
Codex gets a Unity plugin
eric provencher·4 hours ago