Strata with multi gpu explanation

Explain Like I'm Normal

A user experimenting with Strata discovered that adding multiple GPUs increased token throughput but failed to reduce the overall system RAM footprint. This highlights how certain inference engines distribute expert weights across VRAM while maintaining a primary cache in system memory. Understanding the trade-off between disk offloading and multi-GPU parallelization is key for local LLM builders targeting consumer hardware.