1-bit Qwen 3.8 2.4T runs on Mac Ultra 512 via Unsloth iQ1_S
A Reddit user reports running the 1-bit quantized Qwen 3.8 2.4T (a95b) using Unsloth's iQ1_S format, consuming 508 GB on a Mac Ultra 512. The post links to Unsloth's documentation for the model.
1 source
Daily brief
Get tomorrow's AI brief in your inbox
More stories today
- Skeptic shares first impressions of ChatGPT Plus
- Hard sci-fi authors largely oppose LLMs, survey finds
- Anthropic tests folderless Claude Code sessions on Desktop and iOS
- Ethan Mollick: Using weaker AI for human-facing content may soon be disrespectful
- Pocket TTS training stack open-sourced