eli-normalWTF 7.4via Hacker News Frontpage
90% of US working hours are spent on tasks not covered well by AI benchmarks
"Models are passing the Bar but can't figure out your messy spreadsheets."
Explain Like I'm Normal
New research shows a massive gap between what AI benchmarks measure and what humans actually do at work. While models ace standardized tests, they struggle with the complex, context-heavy tasks that occupy 90% of US labor hours. This suggests that 'AGI' might be further away than leaderboard scores imply.
#benchmarking#labor-market#evaluation#productivity
GET THE DAILY CHAOS
The only newsletter for people who read AI news at 3am and feel things. One email a day.