AnalysisDevelopersOctober 24, 2026

ANEMLL Forge 0.2.1 runs Qwen3.8-27B on M6 Neural Engine

Read original source →reddit.com

On a 32GB M6 Mac Mini, ANEMLL Forge 0.2.1 runs Qwen3.8-27B at up to 192K context with INT8 K/V cache and a smaller drafter sharing the target's output head, saving 0.86 GB of ANE memory at the same speed. Decode rates vary by content: JSON 35–62 tok/s, code 18–32, prose 10–17.

1 source

More stories today

Open the live feed