NVIDIA NIM optimizations deliver 2.5x throughput on Nemotron 3 Ultra
NVIDIA says full-stack NIM tuning reaches up to 2.5x higher throughput for agentic workloads on 4xB200 hardware, benchmarked at 64K context, 400 output tokens, 76% KV reuse and 50 TPS/user (20 ms ITL). NIM Certified adds inference-stack updates, CVE handling and commercial support via NVIDIA AI Enterprise.
1 source
More stories today
Claude Code 2.1.268 adds gateway pricing and self-hosted runner cleanup
Claude Code 2.1.268 lets admins set pricing in gateway.yaml so signed-in clients get matching rates and /cost telemetry aligns with the spend meter. It also adds a gatewayInternalNetworks setting and a --remove-session-state flag for self-hosted runners.
Claude Code Changelog·38 minutes ago
AI agents cut quantum attack resource benchmark 86%
Over 100 participants in Eigen Labs' ECDSA.Fail competition cut the secp256k1 circuit resource score from 10.75 billion to 1.496 billion. The leading circuit used 1,151 logical qubits and ~1.3 million Toffoli gates; a later design went below 1 million gates.
Decrypt·48 minutes ago
WIRED podcast weighs ex-Anthropic researcher's AI doomsday warning
Uncanny Valley episode examines a former Anthropic researcher's viral resignation claim that AI could wipe out humanity within a decade, with WIRED's Will Knight assessing whether the doom narrative is overblown. Episode also covers Apple's $2,000 foldable iPhone Duo and a Census report built on faulty data.
Wired·52 minutes ago
Substack essay reflects on weeks of AI news
Melanie Mitchell·55 minutes agoOpenAI launches Agents API in public beta
The Agents API is a managed service powered by the Codex harness that handles orchestration, long-running sessions, and context management. It is available in public beta, with MCP tool connections and shareable runbook reports.
OpenAI Blog·1 hour ago
Claude chat pauses now cite a specific reason, users report
Reddit users report Claude chat pauses now display a stated reason, with one user flagged for "reasoning_extraction."
r/ClaudeAI·1 hour ago
OpenAI releases GPT-Live-1 voice model in the API
GPT-Live-1 brings ChatGPT's full-duplex conversations to the API, letting voice agents listen while they speak and work with the models and harness of the developer's choice. The New Stack reports one team deleted 23,000 lines of code after the split.
The New Stack·1 hour ago
Salesforce launches Enterprise AI Harness combining six tools
Salesforce introduced its Enterprise AI Harness on Thursday, described as a formalized amalgamation of AI harness concepts and infrastructure the company has been aligning. The company said "no single system has the complete answer" for completing a straightforward business task.
