A system-aware taxonomy of KV cache optimization methods for efficient LLM serving — covering temporal, spatial, and structural behaviors at serving time.
A behavior-oriented taxonomy organizing system-aware KV cache optimization into three dimensions. Click any subcategory to filter the paper list below.