SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
breakthroughsWTF 5.6via arXiv cs.AI

Repair, Retry, and the Cost of Hindsight: Verifier Feedback in Formal Theorem Proving

"Turns out LLMs aren't learning from their mistakes, they're just getting a second guess."

Explain Like I'm Normal

Researchers investigated why 'self-repair' in mathematical theorem proving often fails to beat simple random guessing. The study found that while compiler feedback helps, showing the model its previous failure actually confuses it, creating a zero-sum gain. This suggests that for AGI to master formal logic, we need better ways to handle 'hindsight' than just dumping error logs into a prompt.

Read original ↗
#reasoning#lean#verification#qwen#deepseek

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.