SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
breakthroughsWTF 6.9via r/singularity

Agents Last Exam will be saturated by next February at the latest.

"benchmark speedrunning is the only olympic sport that actually matters now."

Explain Like I'm Normal

A new industry-standard benchmark for AI agents, designed to be nearly impossible, is being solved far faster than experts predicted. Current performance trajectories suggest that the most difficult reasoning and tool-use tasks will be saturated by top-tier models by early 2025. This indicates that our current methods for measuring 'AGI-level' agency are being outpaced by rapid architectural improvements.

Read original ↗
#benchmarks#agentic-ai#scaling-laws#evaluation

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.