SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
toolsWTF 5.2via r/MachineLearning

Open GPU kernel engineering series: naive GEMM to FlashAttention, H100 and Blackwell (44 sessions, code public) [P]

"Why wait for Blackwell when you haven't even saturated your memory bandwidth yet?"

Explain Like I'm Normal

A comprehensive 44-session open-source series teaching GPU kernel engineering from scratch, focusing on data-movement bottlenecks rather than just raw compute. The course guides builders through the roofline model and implements high-performance kernels like FlashAttention for H100 and Blackwell architectures. It is a rare, deep-technical resource for anyone trying to squeeze every drop of performance out of modern silicon.

Read original ↗
#cuda#gpu-kernels#h100#flash-attention#optimization

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.