SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
breakthroughsWTF 5.6via r/MachineLearning

Verbosity is not faithfulness: an architectural argument that reasoning models cannot perform faithful inference [D]

"Your model's CoT is just post-hoc vibes and we have the math to prove it."

Explain Like I'm Normal

A new architectural critique argues that current LLMs cannot perform 'faithful' reasoning because the internal logic and the final answer are generated by the same probabilistic process. This means the chain-of-thought is an influential narrative rather than a strict logical constraint. True AGI might require a paradigm shift where reasoning and inference are decoupled to prevent the model from hallucinating its own logic.

Read original ↗
#interpretability#reasoning#o1#architecture

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.