SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
toolsWTF 6.0via r/LocalLLaMA

Qwen3.6 35b Q2_XXS: Being GPU poor in 2026 is not so bad

"Your toaster is now a game studio thanks to extreme quantization."

Explain Like I'm Normal

A user successfully ran a 35B parameter Qwen model on a low-end laptop with just 8GB of RAM and no dedicated GPU. By using ultra-aggressive IQ2_XXS quantization, the model can still generate functional game code at 3 tokens per second on hardware usually reserved for basic web browsing. This proves that high-end reasoning capabilities are rapidly becoming accessible to the 'GPU poor'.

Read original ↗
#quantization#local-llm#qwen#edge-ai

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.