SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
toolsWTF 3.9via r/LocalLLaMA

Strata 2 beta running at half speed?

"Beta update turns 4090s into expensive space heaters."

Explain Like I'm Normal

Users are reporting significant performance regressions in the Strata 2.0 beta, with inference speeds dropping from 155 t/s to under 100 t/s on high-end dual GPU setups. This highlights the volatility of local quantization frameworks where new 'optimizations' can often break specific hardware configurations. Builders should wait for the stable release before migrating production workflows.

Read original ↗
#quantization#gpu#local-llm#performance

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.