How-ToDevelopersSeptember 26, 2026

Oh My Pi adds custom model configs for vLLM, llama.cpp, SGLang

Read original source →doug.sh

Oh My Pi (omp) reads custom models from ~/.omp/agent/models.yml, with working configs for vLLM, llama.cpp, LM Studio, Ollama, SGLang and Lemonade. Configs copied from the earlier tuning post must be updated for omp 18.2.7+, which added its own local provider and requires qwenTemplateReasoningEffort: true.

1 source

More stories today

Open the live feed