Skip to content

Pull requests: vllm-project/vllm

New pull request New
Clear current search query, filters, and sorts
444 Open 4,981 Closed
444 Open 4,981 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add docker-compose.yml and corresponding .env unstale
#2895 opened Feb 16, 2024 by WolframRavenwolf Loading…
12
[WIP][2/n] Non-blocking sampler with Triton kernel
#3626 opened Mar 26, 2024 by Yard1 • Draft
[Misc] Add attention sinks
#3515 opened Mar 19, 2024 by felixzhu555 • Draft
8
Dynamic Multi LoRA Load \ Delete Support frontend needs-rebase unstale
#3496 opened Mar 19, 2024 by gauravkr2108 Loading…
1
8
silu_and_mul kernel only supports contiguous tensors action-required needs-rebase unstale
#3324 opened Mar 11, 2024 by mwbyeon Loading…
4
Speedup model loading with safetensor format when gpu is available needs-rebase unstale
#3185 opened Mar 4, 2024 by chaomengyuan Loading…
7
feat: quadratic + cubic sampling frontend needs-rebase unstale
#3167 opened Mar 3, 2024 by AlpinDale Loading…
13
fix: ignore non-LoRA tensors in adapter model needs-rebase unstale
#3151 opened Mar 1, 2024 by AlpinDale Loading…
6
chore(outputs): make return class into dataclass unstale
#3017 opened Feb 24, 2024 by aarnphm Loading…
6
torch.compile() support needs-rebase unstale
#3014 opened Feb 23, 2024 by ani300 Loading…
6
[Minor] Add benchmark for activation layer needs-rebase unstale
#3009 opened Feb 23, 2024 by esmeetu Loading…
7
Directly call cublas in awq_dequant
#2929 opened Feb 20, 2024 by zcnrex • Draft
3
support stop_token_ids_group like stop_str in check_stop needs-rebase unstale
#2926 opened Feb 20, 2024 by LokiLiu Loading…
8
Refactor openai completion api w.r.t Prefix Cache frontend needs-rebase unstale
#2516 opened Jan 20, 2024 by Avinash-Raj Loading…
4
Explicit packed params in preparation for more LoRA support needs-rebase unstale
#2843 opened Feb 13, 2024 by pcmoritz Loading…
5
[CI/Build] A perplexity-computing test for the FP8 KV cache system. Originally used in the context of PR #3290 ci/build needs-rebase unstale
#3730 opened Mar 29, 2024 by Alexei-V-Ivanov-AMD Loading…
29
Update config.py for models which use_dynamic_ntk needs-rebase unstale
#1388 opened Oct 17, 2023 by ZeyuTeng96 Loading…
3
A more memory-efficient(1/9) and faster (10×) cuda kernel for performing top-k and top-p operations. ci/build needs-rebase unstale
#1416 opened Oct 19, 2023 by SuperCB Loading…
16
[docs] add load balancing examples
#1837 opened Nov 29, 2023 by imoneoi Loading…
9
[WIP] Qwen-style dynamic-NTK ROPE kernel for long sequence support needs-rebase unstale
#1860 opened Nov 30, 2023 by ZiyueHuang Loading…
13
[FIX] Fix shape mismatch for swapped sequences when logprobs > 0 needs-rebase unstale
#1971 opened Dec 7, 2023 by derange-alembic Loading…
8
add policy needs-rebase unstale
#2071 opened Dec 13, 2023 by xxw1995 Loading…
4
Allow single LLM step to generate multiple tokens needs-rebase unstale
#2120 opened Dec 15, 2023 by LiuXiaoxuanPKU Loading…
3
Adds support for gunicorn multiprocess process ci/build frontend needs-rebase unstale
#2818 opened Feb 8, 2024 by jalotra Loading…
9
Prefix caching and deallocation mechanism documentation Improvements or additions to documentation frontend needs-rebase unstale
#2511 opened Jan 19, 2024 by jadielam Loading…
19
ProTip! Mix and match filters to narrow down what you’re looking for.