SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
breakthroughsWTF 5.3via arXiv cs.AI

DrawingVQA: A Real-World Benchmark for Multi-Depth Visual-Textual Reasoning on Construction Drawings

"MLLMs are great at memes, but can they actually build a skyscraper without it falling down?"

Explain Like I'm Normal

Researchers have launched DrawingVQA, a new benchmark testing how well multimodal models understand complex construction blueprints. Unlike standard photo datasets, these drawings require models to synthesize abstract geometry, symbolic notations, and technical tables simultaneously. Early results show that while models are getting smarter, high-stakes engineering reasoning remains a significant hurdle for current AI.

Read original ↗
#vqa#mllm#engineering#benchmark

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.