eli-normalWTF 6.9via arXiv cs.AI
AI advice suppresses people's willingness to say "I don't know", even when the advice is wrong and accuracy is incentivized
"POV: You're now 2x more confident about being 100% wrong because the chatbot said so."
Explain Like I'm Normal
New research shows that using AI makes people stop saying 'I don't know,' even when the AI provides blatantly incorrect information. Despite accuracy being incentivized, participants were three times more likely to be wrong while their confidence in those errors nearly doubled. It turns out AI isn't just a tool for answers; it's a tool for systematic overconfidence and the death of human skepticism.
#human-computer-interaction#hallucinations#psychology#alignment
GET THE DAILY CHAOS
The only newsletter for people who read AI news at 3am and feel things. One email a day.