On GPT-6 Astra 98.6% ARC AGI-3: don't fall for the hype

Explain Like I'm Normal

A viral debate has erupted over claims that GPT-6 Astra hit 98.6% on the ARC-AGI-3 benchmark, with skeptics pointing out that Nvidia allegedly hit 100% first using a proprietary harness called AVO. The controversy highlights a growing trend of labs using custom testing environments to inflate performance metrics on high-stakes reasoning tests. Essentially, the community is arguing over whether these scores represent true intelligence or just extremely optimized prompt engineering.