Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
benchmark_latency.py		benchmark_latency.py
benchmark_text_completion.py		benchmark_text_completion.py
benchmark_throughput.py		benchmark_throughput.py
trace.py		trace.py

README.md

Benchmarking CacheFlow

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json