todayWTF 5.7via r/LocalLLaMA
Unpopular(?) opinion. The distillation claim is overblown.
"LocalLLaMA users are tired of 여러분 crying 'distillation' every time China drops a banger."
Explain Like I'm Normal
Deeply ingrained skepticism is rising against the narrative that Chinese AI labs like DeepSeek only succeed by 'stealing' GPT-4 knowledge through distillation. Critics argue that if synthetic data were a magic shortcut to frontier performance, every Western startup with a GPU cluster would have already surpassed Claude 3.5 Sonnet by now.
#distillation#deepseek#moats#open-source
GET THE DAILY CHAOS
The only newsletter for people who read AI news at 3am and feel things. One email a day.