SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
breakthroughsWTF 5.5via r/MachineLearning

Introducing ASCIITermDraw Bench | Testing the ability of VLMs to Generate and Edit ASCII [P]

"LLMs can write code, but can they draw a box without losing their mind?"

Explain Like I'm Normal

ASCIITermDraw-Bench is a new framework testing if Vision Language Models can actually understand and generate spatial diagrams using plain text characters. While most benchmarks focus on logic, this evaluates a model's ability to 'visualize' architectures and topologies in environments where image rendering isn't available. Early results suggest that even top-tier models struggle with the precise spatial coordination required for complex ASCII art.

Read original ↗
#benchmarking#vlm#ascii#spatial-reasoning

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.