Skip to content

Pull requests: vllm-project/vllm

New pull request New
Clear current search query, filters, and sorts
457 Open 5,125 Closed
457 Open 5,125 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

DRAFT: Add transformers backend support ci/build
#11330 opened Dec 19, 2024 by ArthurZucker • Draft
4 👀 5
[Kernel][Core][WIP] Tree attention and parallel decoding needs-rebase unstale
#4325 opened Apr 24, 2024 by yukavio Loading…
4 👀 5
[Model] Add Support for Ovis1.6-Gemma2-9B Model
#11240 opened Dec 16, 2024 by Player256 Loading…
2
@Isotr0py
10 👀 3
[Hardware][Nvidia][Core][Feature] new feature add: vmm(virtual memory manage) kv cache for nvidia gpu ci/build needs-rebase unstale
#6102 opened Jul 3, 2024 by izhuhaoran Loading…
60 👀 3
[Core] Support sparse KV cache framework needs-rebase
#5752 opened Jun 21, 2024 by chizhang118 Loading…
4 👀 3
[Hardware][Ascend] Add Ascend NPU backend ci/build needs-rebase
#8054 opened Aug 31, 2024 by wangshuai09 Loading…
12 tasks done
106 👀 3
[WIP] AWQ Faster Kernels
#3289 opened Mar 8, 2024 by casper-hansen • Draft
3 tasks done
12 👀 2
[Bugfix]Fix evict v2 with long context length needs-rebase unstale
#5411 opened Jun 11, 2024 by puf147 Loading…
4 👀 2
GPTQ & AWQ Fused MOE needs-rebase unstale
#2761 opened Feb 5, 2024 by chu-tianxiang Loading…
3 tasks done
41 👀 1
Add control panel allow manage multi vllm instances frontend needs-rebase unstale
#4861 opened May 16, 2024 by leiwen83 Loading…
1
12 👀 1
[Bugfix] add input embedding frontend
#11684 opened Jan 2, 2025 by Bryce1010 Loading…
2
6 👀 1
[core] Sampling controller interface needs-rebase unstale
#6273 opened Jul 9, 2024 by mmoskal Loading…
1
24 👀 1
[Core] generate from input embeds needs-rebase
#6869 opened Jul 27, 2024 by Nan2018 Loading…
2
85 👀 1
[ DO NOT MERGE ] grpc openai server prototypes
#6839 opened Jul 26, 2024 by robertgshaw2-neuralmagic • Draft
1 👀 1
[Not for review] Test multimodal with adag
#9328 opened Oct 14, 2024 by ruisearch42 Loading…
1 👀 1
(Dont Merge) Add rwkv6
#6749 opened Jul 24, 2024 by uniartisan • Draft
1 👀 1
[Model] Add moondream vision language model documentation Improvements or additions to documentation needs-rebase unstale
#4228 opened Apr 20, 2024 by vikhyat Loading…
10 👀 1
[V1] Support Pixtral-HF on V1
#11409 opened Dec 22, 2024 by ywang96 • Draft
2 👀 1
[V1] Supports scheduling asynchronousization on V1 version needs-rebase
#11133 opened Dec 12, 2024 by lixiaolx Loading…
2 👀 1
[WIP] Deepseek V2 MLA
#10927 opened Dec 5, 2024 by simon-mo • Draft
4 of 11 tasks
6 👀 1
bug fixed: cuda out of memory lead to 'AsyncEngineDeadError: Background loop has errored already. unstale
#5173 opened Jun 1, 2024 by charent Loading…
4
5 👀 1
[WIP] Qwen-style dynamic-NTK ROPE kernel for long sequence support needs-rebase unstale
#1860 opened Nov 30, 2023 by ZiyueHuang Loading…
13
[FIX] Fix shape mismatch for swapped sequences when logprobs > 0 needs-rebase unstale
#1971 opened Dec 7, 2023 by derange-alembic Loading…
8
[Misc] Support register quantization method out-of-tree
#11969 opened Jan 12, 2025 by ice-tong Loading…
1
1
Add Tail-Free sampling frontend needs-rebase unstale
#2375 opened Jan 8, 2024 by 0x7o Loading…
2
ProTip! Add no:assignee to see everything that’s not assigned.