SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
toolsWTF 5.9via r/LocalLLaMA

Kapitsa: open-source Apple Silicon optimized Metal engine built for Qwen and Nemotron. See benchmarks of Qwen 27B, Nemotron + 8 other models on an M1 Pro (16GB), M4 Pro (48GB) and M5 Max (128GB)

"Local models on Mac go brrr: Kapitsa drops custom Metal kernels for peak performance."

Explain Like I'm Normal

Kapitsa is a new open-source inference engine specifically optimized for Apple Silicon and the Metal API. By focusing strictly on Qwen and Nemotron model architectures, the developers achieved significant speed gains for running coding agents on local hardware without internet access. Benchmarks show impressive results across M1 to M4 chips, making it a powerful tool for dev-heavy local workflows.

Read original ↗
#apple-silicon#inference#open-source#qwen#metal

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.