llama.cpp PR speeds up IQ model prompt processing with AVX2
A draft PR by bartowski1182 adds AVX2 optimizations for large-batch prompt processing of IQ quantized models, targeting CPU performance during imatrix and perplexity tasks. Benchmarks on EPYC 9654 show speedups for Qwen3.6-27B and Qwen3.6-35B-A3B.
1 source
More stories today
LLaDA-Image: unified 6B image/edit model released
LLaDA-Image, a unified 6B-parameter image generation and editing model, is now available on GitHub, arXiv, and Hugging Face.
r/StableDiffusion·3 hours ago
AI-generated menus look eerily wrong, says Reality Defender CTO
Reality Defender CTO Alex Lisle says AI menus look like "an alien trying to make a pizza," trained on a narrow, "pleasing" aesthetic from corpora like 2015 Chili's menus. Customers viscerally sense something is off, driving demand for AI-detection tools.
TechCrunch·3 hours ago
Rauch: Feedback is a gift, now a prompt for agents
Guillermo Rauch·4 hours agoDevelopers by email
Get an email when there's news on Developers
No news that day, no email.
Study: coding agents often prefer grep over LSP semantic tools
A pilot study found coding agents often stick with grep over LSP-backed semantic navigation, and forcing the semantic path sometimes reduced task success. The author argues tool LLM-friendliness—context and output shape—matters as much as precision.
Hacker News·4 hours agoAndreessen-backed AI startup Gimlet valued at $3B
Gimlet, which helps divide AI tasks among different chips, raised $300 million in a new round, valuing the company at $3 billion.
Bloomberg Technology·5 hours ago
Fan video uses MiniMax to turn Star Wars characters into dancers
A Reddit user shared a video made with MiniMax that turns Anakin and Obi-Wan into dancers, with music from Suno. The clip is a creative test using movie screenshots.
r/StableDiffusion·5 hours ago
Penn AI lab research on AI progress shared
Ethan Mollick·6 hours agoRay Kurzweil joins brain-computer startup Subsense
Robert Scoble·6 hours ago
