AnalysisDevelopersOctober 18, 2026

Strata builds before 0.1.45 default to greedy decoding

Read original source →reddit.com

A LocalLLaMA user reports that Strata run configs lacking a `sampling` block decoded greedy on builds before 0.1.45 whenever the request set no sampling of its own. The setup ran on an RTX 4090, i9-14900K and 64GB DDR5-5800, moving from IQ2_XS to Unsloth's UD-IQ4_XS.

1 source

More stories today

Open the live feed