Memory is needed for more than just weights(lttlabs.com)

https://www.lttlabs.com/articles/2026/07/10/llm-quantization-part-2-youre-gonna-need-a-bigger-vram