Ai2's StateBench tests how LLMs track state changes in long documents
Read original source →allenai.org
StateBench grades state tracking at four difficulty levels; recurrent and hybrid models like Gated DeltaNet generalize much farther than transformers when trained directly on the tasks. Frontier models including Gemini 3.8 Flash, Claude Opus 5.5, and GPT-6 Sol and Luna still break down on harder variants as inputs grow longer.
1 source
More stories today
Mercor routes 63B tokens through Vercel AI Gateway in 10 days
Mercor cut batch jobs from 12 hours to 2-3 hours after moving open-model workloads to Vercel AI Gateway, which added inference capacity and failover routing when providers hit rate limits. In its first 10 days on Gateway it routed 18M requests and 63B tokens.
Vercel Blog·1 hour ago
AWS shows ServiceNow token exchange with Bedrock AgentCore Gateway
AWS walkthrough shows how Bedrock AgentCore Gateway propagates user identity to ServiceNow APIs via on-behalf-of token exchange, so downstream calls carry the initiating user rather than the application itself.
AWS AI Blog·1 hour ago
Gen Digital built Norton Revamp's AI news engine on Bedrock AgentCore
Gen Digital used Amazon Bedrock AgentCore Web Search to power Norton Revamp's AI-curated news feed for professionals managing their online reputation. The AWS customer post details the build.
AWS publishes guide to building ultra-low-latency voice AI apps
AWS technical how-to covers building voice-first conversational applications on AWS, spanning virtual assistants, AI contact centers, real-time translation and accessibility tools. It references Amazon Connect and Amazon SageMaker AI as the underlying services.
NVIDIA releases 9.6M-parameter NemotronLabs RE-USE speech cleanup model
NVIDIA's open multilingual RE-USE model restores speech quality across real-world degradations, removing background noise, echo and other distortions. It ships with only 9.6M parameters, and a demo plus downloadable weights are available on Hugging Face.
r/LocalLLaMA·1 hour ago
IBM Research's Palette teaches a small model to build decks in your design language
Hugging Face blog post from IBM Research describes Palette, a small model trained to generate presentation decks that follow a given design language. No benchmark scores, parameter counts, or release details are given in the available snippet.
Hugging Face Blog·1 hour ago
Amazon Bedrock adds India-based inference for Kimi K3
Moonshot AI's open-weight Kimi K3, described as reaching frontier-level coding and agentic intelligence at release, can now run with in-country inference in India on Bedrock, alongside existing global and US-based options.
Google to disable AI tools for schools by default, Search included
Starting next year, K-12 schools must explicitly opt in to Gemini, NotebookLM, Gemini in Classroom, and Search AI features. Schools that restrict AI entirely lose Google Search too, since AI is now integrated into it, VP of education Chris Phillips told The New York Times.
TechCrunch·2 hours ago
