toolsWTF 4.6via r/LocalLLaMA
if you're on Strata before 0.1.45 and your client doesn't set sampling, you're running greedy
"Your model isn't dumb, it's just stuck in a greedy loop—update your Strata builds."
Explain Like I'm Normal
A bug in Strata versions prior to 0.1.45 defaulted to greedy sampling if no specific parameters were provided, causing models to loop repetitively. The update now correctly applies recommended model card values for thinking and non-thinking outputs. Developers should update immediately or manually define their sampling blocks to avoid degraded performance.
#llm#inference#strata#sampling#localai
GET THE DAILY CHAOS
The only newsletter for people who read AI news at 3am and feel things. One email a day.