Qwen3.8-27B runs at 130 tok/s on Kaggle's free TPU
A user got Qwen3.8-27B in bf16 with no quantization running on Kaggle's free TPU v5e-8 at ~130 tok/s single-stream and 10,300 tok/s prefill, with the full native 262,144-token context. Other local setups report ~280 tok/s on dual Radeon AI Pro R9700s and ~75 tok/s decode on a 16GB RTX 5080.
1 source
More stories today
AMD-backed Korean AI startup Upstage weighs pre-IPO round
Upstage, a South Korean AI startup backed by AMD, is considering a pre-listing funding round among several capital-market options, per co-founder comments to Bloomberg. No round size, valuation, or timeline was disclosed.
Bloomberg Technology·3 hours ago
Reddit users discuss tasks they stopped using Claude for
r/ClaudeAI thread asks what people tried Claude on, decided wasn't worth the round trip, and went back to doing by hand. No specific model version, benchmark, or product change is cited.
r/ClaudeAI·4 hours agoEmily Bender critiques pro-AI science communication and OpenAI math claims
Emily M. Bender·4 hours agoAlibaba to lead $300M round in UniPat AI at $2.5B valuation
Alibaba Group is slated to lead a $300 million investment in AI training and benchmarking startup UniPat AI, valuing it at $2.5 billion. The company was founded by a former Alibaba intern.
Kimi K3 tops Fable 5.1 by 60% on Harvey Lab-AA legal tasks
Together AI·4 hours ago
Shield AI co-founder discusses APAC expansion plans
Shield AI co-founder and president Brandon Tseng outlined the defense startup's growth strategy and expansion into APAC markets in a Bloomberg: The Asia Trade interview.
Independent researcher releases audio model for text-to-synth generation
The model generates infinite one-shots for music production and turns text prompts into fully playable synths, treating timbre as a separately controllable attribute. The release includes the model weights, an inferencing pipeline, and a video walkthrough of the training process.
r/LocalLLaMA·4 hours ago
Codex gets a Unity plugin
eric provencher·4 hours ago