BeeLlama.cpp v0.4.0: KVarN, KV precision tail, q2_0-q3_1 KV cache, upstream rebase

Explain Like I'm Normal

A specialized fork of llama.cpp has released an update focusing on aggressive KV cache quantization, allowing users to run large models on much smaller hardware. It introduces new precision tails and low-bit cache types like q2_0, effectively fitting longer contexts into limited memory. The developer also cleaned up the codebase, removing outdated features that didn't survive rigorous benchmarking.