DeepSeek V4 Flash runs at ~100 tok/s on 4× RTX 3060
A user ran the 143–144 GiB DeepSeek-V4-Flash-0731 UD-Q4_K_XL GGUF on four RTX 3060 12GB cards, achieving ~100 tok/s prompt processing with a 360k–376k context window. Hardware included an Intel Core i9-10920X and 128 GB DDR4-3200 RAM.
1 source
More stories today
LLaDA-Image: unified 6B image/edit model released
LLaDA-Image, a unified 6B-parameter image generation and editing model, is now available on GitHub, arXiv, and Hugging Face.
r/StableDiffusion·3 hours ago
AI-generated menus look eerily wrong, says Reality Defender CTO
Reality Defender CTO Alex Lisle says AI menus look like "an alien trying to make a pizza," trained on a narrow, "pleasing" aesthetic from corpora like 2015 Chili's menus. Customers viscerally sense something is off, driving demand for AI-detection tools.
TechCrunch·3 hours ago
Rauch: Feedback is a gift, now a prompt for agents
Guillermo Rauch·4 hours agoAI Models by email
Get an email when there's news on AI Models
No news that day, no email.
Study: coding agents often prefer grep over LSP semantic tools
A pilot study found coding agents often stick with grep over LSP-backed semantic navigation, and forcing the semantic path sometimes reduced task success. The author argues tool LLM-friendliness—context and output shape—matters as much as precision.
Hacker News·4 hours agoAndreessen-backed AI startup Gimlet valued at $3B
Gimlet, which helps divide AI tasks among different chips, raised $300 million in a new round, valuing the company at $3 billion.
Bloomberg Technology·5 hours ago
Fan video uses MiniMax to turn Star Wars characters into dancers
A Reddit user shared a video made with MiniMax that turns Anakin and Obi-Wan into dancers, with music from Suno. The clip is a creative test using movie screenshots.
r/StableDiffusion·5 hours ago
Penn AI lab research on AI progress shared
Ethan Mollick·6 hours agoRay Kurzweil joins brain-computer startup Subsense
Robert Scoble·6 hours ago
