Shoehorn quantizes models to fit your machine's memory

Open-source tool starts from your actual memory budget and solves a per-tensor mixed-precision assignment, routinely using 99.99% of it. Uses llama.cpp as the backend, with a browser-based GUI that scans Hugging Face's most-downloaded models and streams the fit.