SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
dramaWTF 6.6via r/LocalLLaMA

Deceptive model quantization from AtomicChat?

"LocalLLaMA is currently speedrunning 'The Case of the Missing Bits.'"

Explain Like I'm Normal

A user on r/LocalLLaMA has flagged a popular model creator, AtomicChat, for allegedly mislabeling low-quality 2-bit quants as high-quality 4-bit quants to win the performance/memory race. By disguising smaller files as more complex versions, they may be tricking users into thinking they've found a magic efficiency boost that doesn't actually exist. The community is now investigating whether this is a technical error or a deliberate 'bait and switch' for engagement.

Read original ↗
#quantization#benchmarks#open-source#llm#ethics

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.