Skip to content

Pull requests: vllm-project/vllm

New pull request New
Clear current search query, filters, and sorts
475 Open 5,378 Closed
475 Open 5,378 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Core] tokens in queue metric
#12286 opened Jan 21, 2025 by annapendleton Loading…
4
[ROCm] Faster Custom Paged Attention kernels ci/build rocm
#12348 opened Jan 23, 2025 by tjtanaa • Draft
4
[Bugfix] handle alignment of arguments in convert_sparse_cross_attention_mask_to_dense
#12347 opened Jan 23, 2025 by tjohnson31415 Loading…
@heheda12345
5
FLOP counting for vLLM inference
#12341 opened Jan 23, 2025 by dianastea • Draft
1
[Build] Only build 9.0a for scaled_mm and sparse kernels ci/build ready ONLY add when PR is ready to merge/full CI is needed
#12339 opened Jan 23, 2025 by LucasWilkinson Loading…
2
[Frontend] Generate valid tool call IDs when using tokenizer-mode=mistral frontend
#12332 opened Jan 22, 2025 by rafvasq Loading…
7
[Core] Optimizing cross-attention QKVParallelLinear computation
#12325 opened Jan 22, 2025 by NickLucche Loading…
2 tasks
1
[Hardware][Gaudi][Bugfix] Fix error for guided decoding ci/build
#12317 opened Jan 22, 2025 by zhouyu5 Loading…
7
[do-not-merge][perf-benchmark] cleanup unused docker images/containers ci/build perf-benchmarks
#12306 opened Jan 22, 2025 by khluu Loading…
1
[Feature][Spec Decode] Simplify the use of Eagle Spec Decode
#12304 opened Jan 22, 2025 by ShangmingCai Loading…
@LiuXiaoxuanPKU
3
[Hardware][Gaudi][Feature] Enable Dynamic MoE for Mixtral
#12303 opened Jan 22, 2025 by zhenwei-intel Loading…
1
[Core] Make disaggregated prefill compatible with pipeline parallelism
#12301 opened Jan 22, 2025 by YuhanLiu11 Loading…
1
[Kernel] Pipe attn_logits_soft_cap through paged attention TPU kernels ci/build
#12294 opened Jan 22, 2025 by fenghuizhang Loading…
5
[Core] Optimize topp/topk calculation in sampler
#12156 opened Jan 17, 2025 by afierka-intel Loading…
2
[Core] Prefill Only Tokens Without KV Cache in Batch Requests (Disagg Prefill)
#12285 opened Jan 21, 2025 by Shaoting-Feng Loading…
1
[CI/Build] Add label automation for structured-output / speculative-decoding ci/build
#12280 opened Jan 21, 2025 by russellb Loading…
1
NVIDIA Blackwell codegen ci/build documentation Improvements or additions to documentation
#12271 opened Jan 21, 2025 by johnnynunez Loading…
12
[Model] Enable Inference Support for the New Baichuan-M1 Model documentation Improvements or additions to documentation new model Requests to new models
#12251 opened Jan 21, 2025 by rainkert Loading…
13
[Misc] Move find_loaded_library to platform_aware_utils.py
#12231 opened Jan 20, 2025 by houseroad Loading…
6
[VLM] Merged multi-modal processor for Pixtral
#12211 opened Jan 20, 2025 by Flechman • Draft
@DarkLight1337 @ywang96
2
[V1][Spec Decode] Ngram Spec Decode
#12193 opened Jan 19, 2025 by LiuXiaoxuanPKU Loading…
4 of 5 tasks
21
[Bugfix] fix race condition that leads to wrong order of token returned
#12192 opened Jan 19, 2025 by joennlae Loading…
4
[Misc] Add Gemma2 GGUF support
#12186 opened Jan 18, 2025 by Isotr0py Loading…
1
7
[Kernel] add triton fused moe kernel for gptq/awq moe quantization ready ONLY add when PR is ready to merge/full CI is needed
#12185 opened Jan 18, 2025 by jinzhen-lin Loading…
26
[Quantization/Parameter] WIP: Another Implementation of the Quantization Parameter Subclass Substitution
#12158 opened Jan 17, 2025 by cennn Loading…
7
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.