NVIDIA NIM optimizations deliver 2.5x more users on Nemotron 3 Ultra
Read original source →developer.nvidia.com
NVIDIA benchmarked NIM against an open-source baseline on 4xB200 GPUs with a 64K/400/76% KV-reuse agentic workload at 50 TPS per user (20 ms ITL), reporting up to 2.5x higher throughput. NIM Certified adds inference-stack updates, CVE handling, and commercial support via NVIDIA AI Enterprise.
1 source
More stories today
Coding agents can induce manic overwork with little real output
Thariq·1 hour agoY Combinator video pitches AI for city hall permitting work
Y Combinator argues AI can automate plan reviews, zoning checks, inspections, licensing and public records, work still done largely by hand. It cites 19,000 US cities and notes permits can take longer to obtain than building the house.
YouTube·2 hours ago
Altman: OpenAI weighed flat-fee pricing, backed off after feedback
OpenAI considered dropping token-based pricing for its next model, letting developers submit a prompt and get a price for the work, before negative customer feedback reversed the plan, Sam Altman said. He spoke Thursday.
The New Stack·2 hours ago
DeepMind launches economics of AGI research program
Alex Imas·2 hours ago
EQUS launches beta of EQUS X personal assistant
Robert Scoble·2 hours ago
Brain-wave preference signals shown steering AI face generation
Robert Scoble·2 hours ago
Speridlabs' Idol turns a single image into a 3D Gaussian splat
Idol converts one photo, render, or generated image into up to 1,048,576 Gaussians, output as a standard 3DGS .ply file. It strips the background and frames the object automatically, running on consumer GPUs at 7.2 GB of VRAM.
r/StableDiffusion·2 hours ago
AWS Hydro team builds compiler checks for AI coding agents
Hydro, an open-source Rust framework for distributed systems, added a way to verify a system still works correctly when it resends messages after a failure. Shadaj Laddad said the resulting change was "like a 5000 line PR."
