SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
breakthroughsWTF 5.6via arXiv cs.AI

DuplexSpeechBench-IFEval: Evaluating Implicit Instruction Following in Full-Duplex Voice Agents

"Your AI assistant just learned when to shut up and when to interrupt you properly."

Explain Like I'm Normal

Researchers have released DSB-IFEval, a new benchmark designed to measure how well voice agents handle real-time social cues like backchanneling and floor-taking without being told explicitly. Most agents currently rely on rigid turn-taking, but this framework tests their ability to infer conversational dynamics based on a specific persona. This moves us closer to AI that actually feels like a human on the phone rather than a walkie-talkie.

Read original ↗
#voice#benchmarking#llm#hci

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.