Cut GPU inference cold start from 8 minutes to under a minute
Instrumented full path from pod creation to first inference on a GPU node running a 70B-class model found six bottlenecks, not one. For a 64 GB model, 65% of startup time is spent in one phase.
1 source
More stories today
Claude Code setup: no secrets, restricted network, production infra
A developer shares a Claude Code setup that isolates the agent, restricts network egress, and avoids exposing secrets while running against real production infrastructure. The approach emphasizes measuring progress and using fewer tokens.
r/ClaudeAI·3 hours ago
GPT 6 Ultra completes task in 20 minutes that GPT 5.6 Sol couldn't fix in 3.5 hours
A Reddit user reports GPT 6 Ultra executed a task in 20 minutes that GPT 5.6 Sol hadn't fixed after over 3.5 hours. The task involved refactoring a deployment file with over 28,000 lines of code.
r/ChatGPT·3 hours agoSocial media sentiment trading signals built on Google Gemini and LunarCrush
Tom Doerr·4 hours ago
Developers by email
Get an email when there's news on Developers
No news that day, no email.
Researcher discusses neuron movement in large parameter LLMs
Robert Scoble·4 hours ago
OpenAI gives paid subscribers another banked usage reset
OpenAI is rolling out another banked reset to all paid subscribers, following a rapid rollout. The move comes amid competition, with one user noting Claude also issued a usage reset.
Kimmonismus·4 hours ago
Altman: Astra not the paused model; future one is
Vaibhav Sisinty·4 hours ago
NVIDIA Nsight Compute adds CUDA Tile kernel profiling
NVIDIA Nsight Compute can now profile CUDA Tile kernels directly, giving developers detailed visibility into tile-based GPU code. CUDA Tile enables writing CUDA at a higher level using multidimensional arrays instead of managing threads, blocks, and grids.
YouTube·4 hours ago
AI SREs handle incidents, engineers lose touch with systems
An SRE argues that AI-assisted incident response tools, or "AI SREs," reduce engineers' practice on routine incidents, leaving them less prepared for complex ones. Cites Lisanne Bainbridge's 1983 "Ironies of Automation" paradox.
Hacker News·4 hours ago