Lemonade v10.8 adds auto memory management and MCP tool support

View on Reddit

Dynamic VRAM management auto-unloads idle models and downsizes KV-cache to reclaim GPU memory on the fly. Also adds the ability to call local models as MCP tools, plus cloud offload and Omni improvements.