Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference

Item #:

085713-3773

Details

DOI: https://doi.org/10.52202/085713-3773
Author(s): Yuan Feng, Junlin Lv, Yukun Cao, Xike Xie, S. Kevin Zhou
Pages: 125462-125498 (37 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 38
Date/Location: Held 2-7 December 2025, San Diego, California, USA and 30 November - 5 December 2025, Mexico City, Mexico.
Series: Advances in Neural Information Processing Systems 38
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)

DOI: https://doi.org/10.52202/085713-3773
Author(s): Yuan Feng, Junlin Lv, Yukun Cao, Xike Xie, S. Kevin Zhou
Pages: 125462-125498 (37 pages)
Format: PDF Paper Download
Conference: Advances in Neural Information Processing Systems 38
Date/Location: Held 2-7 December 2025, San Diego, California, USA and 30 November - 5 December 2025, Mexico City, Mexico.
Series: Advances in Neural Information Processing Systems 38
Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)