LaunchDevelopersOctober 2, 2026

llama.cpp adds /v1/systemone endpoint for decision models

Read original source →huggingface.co

The new endpoint takes a state plus typed questions and returns a probability per option in a single forward pass, following the System One format from TypeSafe's Jev so existing clients only need a new base URL. Supported models include Kev-4B, OpenJev, lev, Julia-1 and laya; implementation is in PR #29818.

3 sources

More stories today

Open the live feed