FreeToken: open-source engine runs larger AI models on limited GPU memory

FreeToken is an open-source inference engine that runs MoE models larger than GPU VRAM via bandwidth-adaptive execution. It enables Qwen3.6 35B on an 8GB RTX 4060 laptop at 39 tokens/s without extreme quantization.