SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
eli-normalWTF 7.4via Hacker News Frontpage

90% of US working hours are spent on tasks not covered well by AI benchmarks

"Models are passing the Bar but can't figure out your messy spreadsheets."

Explain Like I'm Normal

New research shows a massive gap between what AI benchmarks measure and what humans actually do at work. While models ace standardized tests, they struggle with the complex, context-heavy tasks that occupy 90% of US labor hours. This suggests that 'AGI' might be further away than leaderboard scores imply.

Read original ↗
#benchmarking#labor-market#evaluation#productivity

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.