Open-source sparse attention keeps Qwen 3.8 27B accuracy at 10M tokens
Read original source →x.comTeam behind an open-source attention method says Qwen 3.8 27B can be sparsified with no observed accuracy loss, and context extended to 10M tokens. Accuracy drops on some specific tasks at that length, but most, such as NIAH, hold up.
1 source
More stories today
OpenAI built Pando, a Git-compatible backend for Codex scale
OpenAI details Pando, a Git-compatible backend built to handle the development volume Codex enables. The post is an engineering write-up on scaling Git at OpenAI.
OpenAI Blog·38 minutes ago
NVIDIA Attribution diagnoses distributed AI workload failures
NVIDIA Attribution correlates logs, metrics, telemetry and scheduler state into a structured diagnosis: outcome, root cause, affected nodes, symptoms and evidence trail. It runs in production across hundreds of thousands of GPUs, analyzing millions of workloads weekly.
NVIDIA Developer Blog·55 minutes ago
Agibot streams 6 wheeled humanoid robots running a store for 24h
A livestream shows six of Agibot's wheeled humanoid robots operating a convenience store continuously for 24 hours. The broadcast is hosted on X.
r/Singularity·1 hour agollama.cpp PR fixes unified KV cache for multi-sequence CUDA runs
Pull request #29510 by am17an adds flash_attn_ext_rows to fix unified KV cache handling when running multiple sequences on CUDA. A LocalLLaMA poster calls it a "really nice speedup" for running multiple local agents.
r/LocalLLaMA·1 hour ago
Trajectory raises $45M Series A at $300M valuation
Sequoia led the round, with Nvidia, Bessemer Venture Partners and Bain Capital Ventures participating. The 18-person startup, founded a year ago by three Stanford classmates, uses continual learning to retrain open source models on feedback so specialists can post-train them without research teams.
TechCrunch·1 hour ago
Open-source world model pitched as free Genie 4 alternative
Matt Wolfe highlights an open-source world model he compares to Genie 4, positioning it as a free alternative. The video points viewers to futuretools.io for the tool listing and newsletter.
YouTube·1 hour ago
Leaks point to unreleased Claude Fable 5.5 and GPT-6.2 Astra
A "Mythos 5.5" label appeared in Anthropic's site code on Nov 1, and a "claude-fable-5-5" entry hit the LiteLLM catalog Oct 13 with specs copied from Fable 5.1. OpenAI's "gpt-6.2-astra" showed up in Codex usage data for some accounts the same day; Anthropic has announced nothing.
Decrypt·1 hour ago
Legora CTO Jacob Lauritzen on building AI agents for lawyers
Legora passed $100M ARR in April, under 18 months after launch, and now counts over 1,800 customers. It raised $550M in March at a $5.55B valuation, then another $550M in October at $8.8B, and made its fifth acquisition of the year, Wexler.
Latent Space·1 hour ago
