From 6cead54617baddc68ae98bfb292f89a1f40b69a8 Mon Sep 17 00:00:00 2001 From: FYYFU <670924314@qq.com> Date: Sat, 2 Nov 2024 19:20:14 -0700 Subject: [PATCH] update --- README.md | 18 ++++++++++++++++-- 1 file changed, 16 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index ed48d1d..25dde25 100644 --- a/README.md +++ b/README.md @@ -2,7 +2,7 @@ ## Model -![alt text](image.png) +![alt text](main.png) ## Performance ![alt text](performance_table.png) @@ -129,4 +129,18 @@ for((i=0;i<1;i++));do done done ``` -Reason-in-a-haystack experiments are conduct based on the data provided by [RMT-team](https://huggingface.co/datasets/RMT-team/babilong). \ No newline at end of file +Reason-in-a-haystack experiments are conduct based on the data provided by [RMT-team](https://huggingface.co/datasets/RMT-team/babilong). + + +## Citation +```markdown +@article{fu2024not, + title={Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning}, + author={Fu, Yu and Cai, Zefan and Asi, Abedelkadir and Xiong, Wayne and Dong, Yue and Xiao, Wen}, + journal={arXiv preprint arXiv:2410.19258}, + year={2024} +} +``` + +## Acknowledgement +We build our project based on [PyramidKV](https://github.com/Zefan-Cai/PyramidKV/tree/main), [Ada-KV](https://github.com/FFY0/AdaKV), [Retrieval Heads](https://github.com/nightdessert/Retrieval_Head/tree/main) and [babilong](https://github.com/booydar/babilong). Many thanks to them for providing open-source code and data! \ No newline at end of file