Delta Inference Engine v0.93 runs DeepSeek-V4.1-Flash-1017 on one RTX 3090
Read original source →github.com
Update keeps 41 tok/s at 192GB/IQ2 quantization while improving output quality, and now runs from 64 GB RAM with first token ~40% sooner. Adds Unsloth quants at full speed, EXL3, basic multi-GPU and public CI.
1 source
More stories today
MobiHealthNews video looks at preparing for AI-enabled care in Southeast Asia
MobiHealthNews published a video segment on readiness for AI-enabled care across Southeast Asia. The item carries no further detail beyond its title and outlet listing.
MobiHealthNews·43 minutes ago
Perplexity launches Teammates, always-on AI agents for work
Teammates run 24/7 in an isolated environment, executing Computer tasks, skills, memory, and tools, and can message coworkers in Slack. Available now for Max subscribers on the web at $200/month; mobile and desktop apps coming soon.
The Verge·50 minutes ago
Claude Code reportedly sends user email addresses to websites
A GitHub issue on the anthropics/claude-code repo claims the tool transmits users' email addresses to websites it visits. The report surfaced on Hacker News without an official Anthropic response.
Hacker News·1 hour agoML PhDs debate publication pressure in the LLM era
r/MachineLearning threads question whether ~4 first-author papers at NeurIPS/ICML/ICLR is now the norm for top-10 US ML PhDs, and whether LLMs have inflated expected output. Students describe a choice between pumping out AI papers and falling behind in the publishing race.
r/MachineLearning·1 hour agoAWS launches Kiro bots with memory for recurring dev jobs
AWS's Kiro bots add persistent memory and support for recurring development jobs, per VentureBeat. The agentic coding agents are positioned to handle scheduled, repeatable engineering tasks rather than one-off prompts.
VentureBeat·1 hour ago
Oxford AI conversations lifted real petition signatures from 21% to 40%
Nav Toor·1 hour ago
Chatbot ads spread as Anthropic keeps Claude ad-free
Over 100,000 advertisers have bought ads in ChatGPT since they debuted in February, and Google expanded AI Mode ads to 10 more countries. Anthropic's IPO filing didn't mention ad revenue, backed by about $112 billion in investor cash.
Wired·1 hour ago
LangChain, Factory and NVIDIA host re:Invent breakfast panel on owning company…
LangChain·1 hour ago