Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on May 20, 2024

• update Decoding Speculative Decoding github repo

  KylinC

  committed
  0e83ad4

  Copy full SHA for 0e83ad4

• 🔥🔥[SQKV] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models(@shanghai AI Laboratory)

  DefTruth

  authored
  271bd69

  Copy full SHA for 271bd69

Commits on May 15, 2024

• 🔥🔥[YOCO] You Only Cache Once: Decoder-Decoder Architectures for Language Models(@microsoft)

  DefTruth

  authored
  a31b3c7

  Copy full SHA for a31b3c7

Commits on May 13, 2024

• Update Trending LLM/LMM Topics

  DefTruth

  authored
  f6a6c0d

  Copy full SHA for f6a6c0d

Commits on May 12, 2024

• 🔥🔥🔥[DeepSeek-V2] DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model(@deepseek-ai)

  DefTruth

  authored
  dc32f2c

  Copy full SHA for dc32f2c

• 🔥🔥[YOCO] You Only Cache Once: Decoder-Decoder Architectures for Language Models(@microsoft)

  DefTruth

  authored
  876ccc4

  Copy full SHA for 876ccc4

Commits on May 10, 2024

• [KV-Runahead] KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation(@apple etc)

  DefTruth

  authored
  86e6612

  Copy full SHA for 86e6612

Commits on May 9, 2024

• Update README.md

  DefTruth

  authored
  d1da65d

  Copy full SHA for d1da65d

• Update README.md

  DefTruth

  authored
  27d4d89

  Copy full SHA for 27d4d89

• [KVCache-1Bit] KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization(@rice University)

  DefTruth

  authored
  9e18cb4

  Copy full SHA for 9e18cb4

• 🔥[vAttention] vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention(@microsoft Research India)

  DefTruth

  authored
  43c5a72

  Copy full SHA for 43c5a72

• 🔥🔥[W4A8KV4] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving(@mit&NVIDIA)

  DefTruth

  authored
  217ab53

  Copy full SHA for 217ab53

Commits on May 2, 2024

• 🔥🔥[ChunkAttention] ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition(@microsoft.com)

  DefTruth

  authored
  8020015

  Copy full SHA for 8020015

Commits on May 1, 2024

• 🔥🔥[KCache] EFFICIENT LLM INFERENCE WITH KCACHE(@qiaozhi He, Zhihua Wu)

  DefTruth

  authored
  0b2a7c6

  Copy full SHA for 0b2a7c6

Commits on Apr 28, 2024

• Update README.md

  DefTruth

  authored
  506f38a

  Copy full SHA for 506f38a

Commits on Apr 27, 2024

• Update README.md

  DefTruth

  authored
  754ec24

  Copy full SHA for 754ec24

• Update README.md

  DefTruth

  authored
  0d74261

  Copy full SHA for 0d74261

• 🔥🔥[RadixAttention] Efficiently Programming Large Language Models using SGLang(@Stanford University etc)

  DefTruth

  authored
  4ddc18a

  Copy full SHA for 4ddc18a

• Merge pull request DefTruth#15 from preminstrel/patch-1

  Show description for 1c728c9
  DefTruth

  authored
  1c728c9

  Copy full SHA for 1c728c9

Commits on Apr 26, 2024

• Update README.md

  preminstrel

  authored
  df86df2

  Copy full SHA for df86df2

• Merge pull request DefTruth#13 from HarryWu-CHN/kvcache-add

  Show description for a699eaf
  DefTruth

  authored
  a699eaf

  Copy full SHA for a699eaf

• Merge pull request DefTruth#14 from Miroier/main

  Show description for 7c0c1a2
  DefTruth

  authored
  7c0c1a2

  Copy full SHA for 7c0c1a2

• Add Microbenchmark

  Show description for 4a51cde
  Miroier

  authored
  4a51cde

  Copy full SHA for 4a51cde

• add gear and keyformer's code

  HarryWu99

  authored
  52576d9

  Copy full SHA for 52576d9

• Merge pull request DefTruth#12 from liyucheng09/main

  Show description for 567180c
  DefTruth

  authored
  567180c

  Copy full SHA for 567180c

• add SnapKV

  liyucheng09

  committed
  7d5664a

  Copy full SHA for 7d5664a

Commits on Apr 24, 2024

• 🔥🔥[RAGCache] RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation(@peking University&ByteDance Inc)

  DefTruth

  authored
  81d70b3

  Copy full SHA for 81d70b3

Commits on Apr 21, 2024

• 🔥[Chunked Prefills] SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills(@microsoft etc)

  DefTruth

  authored
  1aa836a

  Copy full SHA for 1aa836a

• Update README.md

  DefTruth

  authored
  005dd58

  Copy full SHA for 005dd58

• Update README.md

  DefTruth

  authored
  891be64

  Copy full SHA for 891be64

• Update README.md

  DefTruth

  authored
  30dfce8

  Copy full SHA for 30dfce8

Commits on Apr 20, 2024

• 🔥🔥[Hidden Transfer] Parallel Decoding via Hidden Transfer for Lossless Large Language Model Acceleration(@pku.edu.cn etc)

  DefTruth

  authored
  082ea1f

  Copy full SHA for 082ea1f

Commits on Apr 19, 2024

• Merge pull request DefTruth#11 from liyucheng09/main

  Show description for 966a0d5
  DefTruth

  authored
  966a0d5

  Copy full SHA for 966a0d5

• LLMLingua-2

  liyucheng09

  committed
  474f38b

  Copy full SHA for 474f38b

Commits on Apr 15, 2024

• [Infini-attention] Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention(@google)

  DefTruth

  authored
  3575822

  Copy full SHA for 3575822

Pagination

Previous

Next