GPU Memory Tiers for LLM Inference

This is just an orientation table. Headroom is the VRAM left beyond the model weights for the KV cache, activations, CUDA graphs and other runtime overhead. In practice, serving engines such as vLLM also leave a small GPU memory safety margin to reduce the risk of OOMs.etc.