Paper proposes automated tensor scheduling for hybrid CPU-GPU LLM inference

A new paper introduces automated tensor scheduling to improve LLM inference on consumer devices by effectively using both GPU and CPU memory. The method addresses offloading when model weights exceed GPU capacity, aiming to reduce latency overhead.