Skip to content

Pull requests: vllm-project/vllm

New pull request New
Clear current search query, filters, and sorts
29 Open 3,780 Closed
29 Open 3,780 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix]Fix evict v2 with long context length needs-rebase unstale
#5411 opened Jun 11, 2024 by puf147 Loading…
4 👀 2
[Prefill with Prefix Cache] Improve the efficiency of prefilling with prefix cache by allowing a larger batch size needs-rebase unstale
#3402 opened Mar 14, 2024 by MeloYang05 Loading…
@zhuohan123
17
[FIX] Fix shape mismatch for swapped sequences when logprobs > 0 needs-rebase unstale
#1971 opened Dec 7, 2023 by derange-alembic Loading…
8
[Misc] Support HF Hub remote loading for LoRA adapters documentation Improvements or additions to documentation needs-rebase unstale
#4939 opened May 21, 2024 by Isotr0py Loading…
3 tasks done
1
@Yard1
5
[ CI ] Awq Marlin Integration Tests ci/build needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#6627 opened Jul 22, 2024 by robertgshaw2-neuralmagic Loading…
4
[Kernel] Unify the kernel used in flash attention backend needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#6052 opened Jul 2, 2024 by LiuXiaoxuanPKU Loading…
28
[Multi-step] Remove redundant CPU to GPU transfer for non-last rank PP/TP ready ONLY add when PR is ready to merge/full CI is needed
#7715 opened Aug 21, 2024 by SolitaryThinker Loading…
10
Prefix caching and deallocation mechanism documentation Improvements or additions to documentation frontend needs-rebase unstale
#2511 opened Jan 19, 2024 by jadielam Loading…
19
[Misc] Allow for unsigned zero NAN representation in ScalarType ready ONLY add when PR is ready to merge/full CI is needed
#7661 opened Aug 19, 2024 by LucasWilkinson Loading…
6
[Misc]Minor Changes about Worker ready ONLY add when PR is ready to merge/full CI is needed
#11555 opened Dec 27, 2024 by noemotiovon Loading…
5
[V1] 7/N API Server: Update LM-Eval To Use Streaming ci/build ready ONLY add when PR is ready to merge/full CI is needed
#11590 opened Dec 28, 2024 by robertgshaw2-neuralmagic Loading…
3
[Misc][Quark] Upstream Quark format to VLLM ready ONLY add when PR is ready to merge/full CI is needed
#10765 opened Nov 29, 2024 by kewang-xlnx Loading…
30
[Doc] Proofreading documentation documentation Improvements or additions to documentation
#6998 opened Jul 31, 2024 by sgolebiewski-intel Loading…
17
[Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS documentation Improvements or additions to documentation needs-rebase
#6036 opened Jul 1, 2024 by LeiWang1999 Loading…
3 tasks done
82
[v1][stats][1/n] Add RequestStatsUpdate and RequestStats types ready ONLY add when PR is ready to merge/full CI is needed
#10907 opened Dec 4, 2024 by rickyyx Loading…
@robertgshaw2-neuralmagic
23
[Bugfix] Check prompt length < max_model_len for all models in AsyncLLMEngine ready ONLY add when PR is ready to merge/full CI is needed
#10881 opened Dec 4, 2024 by aurickq Loading…
3
[torch.compile] Add torch inductor pass for fusing silu_and_mul with subsequent scaled_fp8_quant operations ci/build frontend ready ONLY add when PR is ready to merge/full CI is needed
#10867 opened Dec 3, 2024 by SageMoore Loading…
36
[Misc] Add multipstep chunked-prefill support for FlashInfer ready ONLY add when PR is ready to merge/full CI is needed
#10467 opened Nov 20, 2024 by elfiegg Loading…
33
[Kernel][ROCm][AMD] fp8 moe configs for MI300X. Mixtral-8x(7B,22B) TP=1,2,4,8 ready ONLY add when PR is ready to merge/full CI is needed rocm
#9820 opened Oct 29, 2024 by divakar-amd Loading…
5
[CI] Move slow entrypoints tests out of fastcheck ci/build
#10052 opened Nov 5, 2024 by mgoin Loading…
3
[Bugfix] limit lora init id greater than 0 ready ONLY add when PR is ready to merge/full CI is needed
#9093 opened Oct 5, 2024 by Ssunbell Loading…
5
[Bugfix] Handle best_of>1 by disabling multi-step scheduling; fail if beam search is invoked with multi-step scheduling frontend needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#8637 opened Sep 19, 2024 by afeldman-nm Loading…
1
23
[Bugfix] fix error due to an uninitialized tokenizer when using skip_tokenizer_init with num_scheduler_steps ready ONLY add when PR is ready to merge/full CI is needed
#9276 opened Oct 11, 2024 by junstar92 Loading…
5
[Hardware][TPU] workaround fix for MoE on TPU ready ONLY add when PR is ready to merge/full CI is needed
#11764 opened Jan 6, 2025 by avshalomman Loading…
1
@robertgshaw2-neuralmagic
11
[V1][Core] Autotune encoder cache budget
#11895 opened Jan 9, 2025 by ywang96 Loading…
28
ProTip! Exclude everything labeled bug with -label:bug.