AnalysisAI ModelsOctober 16, 2026

ORL speeds diffusion LLMs to 2,788 tokens/s on one RTX 5090

Read original source →reddit.com

On-Policy Residual Learning (ORL), paired with a custom inference engine called dlmrt, hits 2,788 tokens/s on a single RTX 5090 while preserving generation quality. The research and code are fully open source.

1 source

More stories today

Open the live feed