SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
breakthroughsWTF 6.7via r/LocalLLaMA

Minimax M3.1 Flash is 428B 23a

"MiniMax calls it 'Flash' but it’s a 428B absolute unit."

Explain Like I'm Normal

Chinese AI lab MiniMax quietly revealed that their new M3.1 Flash model boasts a massive 428 billion parameters, despite the 'Flash' naming usually implying a smaller footprint. It utilizes a Mixture-of-Experts architecture, activating about 23 billion parameters per token to balance speed with high-capacity reasoning. This makes it one of the largest open-ish weights models currently available, though running it locally requires massive VRAM.

Read original ↗
#minimax#moe#llm#inference

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.