Accurate KV Cache Eviction via Anchor Direction Projection for Efficient LLM Inference

December 2025
Zijie Geng, Jie Wang, Ziqi Liu, Feng Ju, Yiming Li, Xing Li, Mingxuan Yuan, Jianye Hao, Defu Lian, Enhong Chen, Feng Wu
Type
Conference paper
Publication
The Thirty-Ninth Annual Conference on Neural Information Processing Systems

Related