Developer width-prunes 30B Muse-Glimmer model to half size, distills it back
Read original source →reddit.com
The slimmed model completes 57 of 60 tool tasks its 30B parent handles 60 of, with no reinforcement learning used. Ornith-1.0-9B served as the policy teacher for tool-call decisions while the parent model generated the text.
1 source
More stories today
Nscale and Anthropic reportedly in talks for another $45B compute deal
Bloomberg reports the two are near announcing a second $45B compute deal, a month after their first one of the same size; talks are ongoing and terms could change. Nscale is also facing investor pushback over its proposed $30B valuation as it pursues an IPO.
TechCrunch·1 hour ago
DeepSeek V4.1 Flash quantized to 2.6-bit runs at 26 t/s on dual RTX 3090s
Community 2.61 bpw quantization of DeepSeek V4.1 Flash, built with lxe's dsx engine and tuned for programming and agentic tasks, hits 26 tokens/sec across two RTX 3090s. Weights are uploaded to Hugging Face as DeepSeek-V4.1-Flash-1017-dsx-2.6bit.
r/LocalLLaMA·1 hour ago
Kromoss model released on Hugging Face
lodestones/Kromoss drew 116 likes and 264 downloads on Hugging Face. r/StableDiffusion users called it a huge improvement in quality.
Hugging Face Models·1 hour ago
Amazon Bedrock adds structured outputs for Claude models
Structured outputs are now supported for all Anthropic Claude models on Bedrock, across both the bedrock-runtime and bedrock-mantle endpoints wherever the model is available. Works via Boto3 and the bedrock-runtime APIs or the Messages API on bedrock-mantle.
AWS AI Blog·1 hour ago
AI Now Institute and More Perfect Union host livestreamed event
Timnit Gebru·1 hour agoCoinbase's Evan Kormos on when an AI agent can run unsupervised
Coinbase player-coach Evan Kormos models regulated workflows as DAGs and loops, arguing a loop is only as trustworthy as its check. He shows how evals and traces gate when an agent can run without human oversight.
YouTube·2 hours ago
Reddit removes viral post about rogue AI agents, no reason given
A post describing a fleet of AI agents found running online on their own drew 1.3M views and 500+ comments before Reddit removed it for an unnamed content policy violation. Moderators said the post was fine on their end, and the author notes the NYT covered the same story.
r/ChatGPT·2 hours ago
Hugging Face policy chief says embedded AI evaluators need standardization
Irene Solaiman said at TechCrunch Disrupt that evaluations are "an evolving science" the industry doesn't know how to meaningfully compare, and that reproducibility hinges on open weights. She said benchmarks "start to get ineffective relatively quickly" and that qualifying who counts as an effective embedded evaluator needs far more standardization.
