AnalysisDevelopersOctober 2, 2026

iPhone used as second GPU for 24GB MacBook to speed Qwen 3.8 27B prefill

Read original source →reddit.com

A Reddit builder offloads part of the context window to an iPhone, reporting 29–44% faster end-to-end prefill for Qwen 3.8 27B on a 24GB M4 Pro MacBook. The phone holds only some layers, so its displayed prefill TPS is not yet end-to-end.

1 source

More stories today

Open the live feed