Qwen3.8-27B hits 2,000 prefill tok/s on RTX 3090
A hyper-optimized inference engine for Qwen3.8-27B on an RTX 3090 reaches 2,000 prefill tokens per second and 132 decode tokens per second. Earlier iterations hit 381 tps single-request decode and 672 tps peak.
How this story unfolded
2 weeks · 0 reports · 5 community posts · from Aug 16
- Aug 16
- Aug 18
- Aug 19
- Aug 21
- Sep 1
More stories today
OpenAI launches ChatGPT Images 2.5
ChatGPT Images 2.5 turns ideas, sketches, and reference photos into more personalized, polished images. Available now via OpenAI.
OpenAI Blog·1 hour ago
Amazon SageMaker Feature Store adds UpdateRecord for feature-level writes
Amazon SageMaker Feature Store now supports feature-level writes via UpdateRecord, enabling updates to individual features without rewriting entire records. The feature is available in the fully managed ML feature repository.
AWS AI Blog·2 hours ago
Bubeck refutes claims in social post
Sebastien Bubeck posted a refutation of unspecified claims, shared on X and discussed on Reddit. Details of the claims and his counterpoints are not provided in the available sources.
r/Singularity·2 hours agoAI Models by email
Get an email when there's news on AI Models
No news that day, no email.
Teachers push back on 'baby slop' AI videos in early learning
AI-generated videos aimed at preschoolers, dubbed 'baby slop,' often lack substance and can include inappropriate content. One YouTube channel, Bright Tunes, has nearly 5,500 AI-generated videos in under a year. Educators are responding by teaching media literacy.
EdSurge·2 hours ago
Claude Platform: cut costs with prompt caching, prompt fixes, effort tuning
Claude Blog details three fixes to reduce Claude Platform costs without sacrificing performance: maximize prompt cache hit rate, remove prompt anti-patterns when upgrading to frontier models, and calibrate effort to the task. Guidance is packaged into the claude-api skill.
Claude Blog·2 hours ago
OpenAI's Sam Altman praises Seb's integrity in joint release
Sam Altman·2 hours ago
Krea2 I2I and Minimax H3 REF2VA used in fan video
A Reddit user shared screen caps from Krea2 I2I and used Minimax H3 REF2VA to create a fan video with audio interviews of Paul and Karen.
r/StableDiffusion·3 hours ago
OpenAI claims AI solution to Navier-Stokes Millennium Prize Problem
OpenAI says its next-gen model solved the Navier-Stokes existence and smoothness problem, a $1M Clay Millennium Prize, using ~10,000 agents over 88 hours. NYU mathematician Tristan Buckmaster alleges OpenAI built on his and Anthropic's work without credit, sparking a dispute.
