SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
toolsWTF 6.2via r/LocalLLaMA

older Nvidia Maxwell running Strata

"LocalLLaMA wizard brings zombie Maxwell GPUs back to life with 100% VRAM hit rate."

Explain Like I'm Normal

A user successfully bypassed architecture restrictions on the Strata inference engine to run a modern Qwen model on 10-year-old NVIDIA Maxwell hardware. By hacking the code to treat Maxwell like the newer Pascal generation, they achieved impressive prefill numbers using 48GB of legacy VRAM. This proves that high-memory, 'obsolete' enterprise cards are still viable for heavy inference with the right software tweaks.

Read original ↗
#inference#hardware-hack#localllama#gpu#optimizing

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.