There's a new PR for llamacpp claiming to boost prompt processing with rocm by around 15%, also fixes a bug which makes Q2_K 28x faster

Explain Like I'm Normal

A new pull request for llama.cpp introduces a 15% boost in prompt processing for ROCm-based systems and fixes a massive bottleneck in low-bit quantization. This bug fix specifically makes Q2_K quants up to 28 times faster on AMD hardware, making extremely compressed models actually usable for local inference. It is a major win for the 'cheap hardware' community trying to run massive models on consumer GPUs.