SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
toolsWTF 4.2via r/LocalLLaMA

2x R9700 layer split side effect

"Local LLM enjoyers discover the secret to silent, multi-GPU bliss."

Explain Like I'm Normal

A user on r/LocalLLaMA found that splitting model layers across two Radeon R9700 cards keeps GPU utilization under 50% per unit during single tasks. This effectively prevents the fans from ramping up, offering a hardware hack for a dead-silent inference workstation. It is a niche but practical tip for home-lab builders dealing with thermal noise.

Read original ↗
#hardware#local-llm#optimization#gpu

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.