eli-normalWTF 4.4via r/LocalLLaMA
Size of AI models. What we mean by "Large"?
"Finally, a hardware-based vibe check for model sizes that actually makes sense."
Explain Like I'm Normal
A community member on r/LocalLLaMA has proposed a standardized classification system for AI models based on the VRAM required to run them. The system ranges from 'Tiny' (under 2GB) to 'Huge' (up to 512GB), aiming to replace the current ambiguity surrounding parameter counts with practical hardware constraints.
#terminology#hardware#localllama#ram
GET THE DAILY CHAOS
The only newsletter for people who read AI news at 3am and feel things. One email a day.