Swiftlet runs 80B Qwen in 4.3 GB RAM on a Mac, 35B on iPhone
Swiftlet, a new open-source project, runs an 80B Qwen model in 4.3 GB of RAM on a Mac and a 35B Qwen on an iPhone.
1 source
Daily brief
Get tomorrow's AI brief in your inbox
More stories today
- Koharu translates manga pages locally using OCR, inpainting, and LLMs
- Orchestration tool runs AI coding agents in parallel, compares answers
- Real-time Gaussian splats generated on mobile devices
- Newtake AI shows off completely AI-generated rap music video
- ChatGPT Work used to install OpenClaw and Ollama, run local model