llama.cpp adds --n-cpu-ffn option for faster dense models

New llama.cpp PR #26622 adds a --n-cpu-ffn option, similar to --n-cpu-moe, letting users offload a specified number of FFN sublayers to CPU for dense models, aiming to speed up low-VRAM inference.
1 source
Daily brief
Get tomorrow's AI brief in your inbox
More stories today
- AWS Quick and fal enable agentic creative workflows
- Anthropic opens 10,000 free Claude seats for scientists
- Researcher breaks Claude Code Opus 5 auto mode with 80% success
- Nvidia CEO Jensen Huang: I wish I had invested more in AI frontier labs
- Apple introduces rubric-based alignment for grounded QA