32 researchers publish comprehensive tokenization survey
Read original source →reddit.com
The survey covers tokenization algorithms and evaluations across all of NLP, assembled over roughly eight months by 32 tokenizer researchers. It is described as the most comprehensive survey of the field.
1 source
More stories today
Nvidia's Jensen Huang says AI chip demand is creating 'enormous amount of jobs'
Speaking to reporters Tuesday, Nvidia CEO Jensen Huang claimed AI chip demand is producing an "enormous amount of jobs." No figures or specific job counts were given in the remarks.
Forbes Breaking News·4 hours ago
OpenAI's Greg Brockman details his vision for AI
Speaking at a Tuesday press gaggle, OpenAI President Greg Brockman said he believes AI "can lift everyone up," framing it as a driver of technological and social advancement.
Forbes Breaking News·4 hours ago
Sam Altman's Dot agent triages his morning workload
OpenAI's new always-on agent, Dot, handles Sam Altman's early-morning triage, flagging only urgent issues so he keeps his "maximum creativity" window. The OpenAI CEO previously lost those hours to whatever fire needed putting out.
Every·4 hours ago
Ming Image 0.1 vs Krea 2 compared across 192 prompts
Side-by-side gallery pits the 6B-parameter Ming Image 0.1 against Krea 2 on 192 prompts, with results posted to imagebench.ai. The poster calls Ming Image very impressive for a 6B model.
r/StableDiffusion·4 hours ago
Creator posts 80s/90s anime-style AI trailer made with ComfyUI
Reddit user Portable_Solar_ZA shared "Crime Busters," a mock 80s/90s anime trailer built in ComfyUI, following an earlier rough cut. The project was originally planned as a submission for the Comfy Sync competition.
r/StableDiffusion·4 hours ago
Reddit users debate the short-lived GPT-6-SOL release
GPT-6-SOL shipped September 22, 2026, and was replaced by GPT-6.1-SOL a week later on September 29. A r/OpenAI poster says 6-SOL was worse than GPT-5.6-SOL and questions whether it was a Terra-class model.
r/OpenAI·4 hours agoAnthropic deprecates Sonnet 4-5, decommissioning November 30, 2026
Anthropic's model-deprecation page lists Sonnet 4-5 as deprecated with a tentative retirement date of November 30, 2026. The table's columns are API model name, current state, deprecated, and tentative retirement date.
r/ClaudeAI·4 hours ago
Claude users ask how to force a handoff .md before chat compaction
A non-developer Claude app user on Mac asks whether long chats can be made to write a handoff .md file before context compaction. Replies suggested hooks and git worktrees, which the poster said were over their head.
r/ClaudeAI·4 hours ago