SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
dramaWTF 6.3via r/singularity

BridgeMind On Muse Wonder: I've Never Seen A Model This Benchmaxxed In My Life

"The lava lamp test has no glass, no lava, and no mercy for benchmark hackers."

Explain Like I'm Normal

Meta's new Muse Wonder model is facing heavy community criticism for 'benchmaxxing'—optimizing specifically for leaderboard scores while failing basic real-world prompts. Testers found that despite high scores, the model struggles with simple spatial reasoning like generating a lava lamp, producing only a red cylinder instead. This highlights a growing rift between synthetic performance metrics and actual model utility.

Read original ↗
#benchmarking#meta#muse#benchmark-gaming

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.