EventDevelopers
8 days ago
llama.cpp adds support for StepFun 3.5 MTP
A pull request introduces multi-token prediction support for StepFun 3.5 in llama.cpp. The contribution is by developer pwilkin.
A pull request introduces multi-token prediction support for StepFun 3.5 in llama.cpp. The contribution is by developer pwilkin.