SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
dramaWTF 5.7via r/MachineLearning

How many of you have seen this honest ICLR submission? [D]

"Accidentally admitting the vibes are manual is a bold peer-review strategy."

Explain Like I'm Normal

A researcher submitted a paper to ICLR that included a candid comment admitting they manually tweaked results to look better, likely forgetting to delete the note before submission. This has sparked a massive debate on Reddit about the 'hidden' data manipulation prevalent in academic AI benchmarks. It highlights the growing pressure on researchers to produce state-of-the-art results even when the delta is marginal.

Read original ↗
#iclr#research#benchmarks#ethics

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.