Skip to content

Pull requests: vllm-project/vllm

New pull request New
599 Open 8,059 Closed
599 Open 8,059 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix] validate grammar and throw 400 error instead of crashing the engine when xgrammar validation fails structured-output v1
#17623 opened May 4, 2025 by Jason-CKY Loading…
1
1
[PERF] Speed up of prepare_inputs / mrope
#17617 opened May 3, 2025 by vadiklyutiy Loading…
1
Use git-path commit in hook
#17616 opened May 3, 2025 by thomasjpfan Loading…
1
1
[BugFix] Fix --disable-log-stats in V1 server mode bug Something isn't working ready ONLY add when PR is ready to merge/full CI is needed v1
#17600 opened May 2, 2025 by njhill Loading…
2
Enable Pydantic mypy checks and convert configs to Pydantic dataclasses frontend structured-output tpu Related to Google TPUs
#17599 opened May 2, 2025 by hmellor Loading…
2
[V1] Disable pickle by default for new serial_utils usage v1
#17596 opened May 2, 2025 by russellb Loading…
1
[Security] Document StatelessProcessGroup security concerns documentation Improvements or additions to documentation
#17591 opened May 2, 2025 by russellb Loading…
1
Feature/vllm/input embedding completion api frontend
#17590 opened May 2, 2025 by Nan2018 • Draft
2
[Model] 1.58bits BitNet Model Support documentation Improvements or additions to documentation
#17588 opened May 2, 2025 by Alex4210987 Loading…
3
[Bugfix][ROCm] Fix incorrect casting in GPTQ GEMM kernel
#17583 opened May 2, 2025 by nlzy Loading…
1
1
Make key optional for rotary embedding ready ONLY add when PR is ready to merge/full CI is needed
#17566 opened May 1, 2025 by sarckk Loading…
3
[WIP] Support multiple kv connectors ci/build frontend v1
#17564 opened May 1, 2025 by mgoin • Draft
1
AMD tests updated experiment ci/build
#17563 opened May 1, 2025 by Concurrensee Loading…
2
Improve configs - the rest! frontend structured-output
#17562 opened May 1, 2025 by hmellor • Draft
15
[WIP][V1][Spec Decode] EAGLE tree-attention v1
#17560 opened May 1, 2025 by wwl2755 • Draft
3 of 9 tasks
7
AMD experimental all tests updated EXPERIMENT (no need to merge) ci/build needs-rebase
#17556 opened May 1, 2025 by Alexei-V-Ivanov-AMD Loading…
2
[WIP] Initial attempt to add microbatching functionality to RowParallelLinear
#17552 opened May 1, 2025 by SageMoore • Draft
1
[Perf] API-server scaleout with all-to-all server-engine comms frontend v1
#17546 opened May 1, 2025 by njhill • Draft
1
[Misc] add get kv cache token capacity frontend v1
#17538 opened May 1, 2025 by lengrongfu Loading…
1
2
[FEAT][ROCm]: Support AITER MLA on V1 Engine ci/build rocm Related to AMD ROCm v1
#17523 opened May 1, 2025 by vllmellm Loading…
1
[prototype] prioritized block soft pinning/evictions documentation Improvements or additions to documentation frontend v1
#17520 opened May 1, 2025 by simon-mo • Draft
1
[V1] Add num_cached_tokens stats for request output ready ONLY add when PR is ready to merge/full CI is needed v1
#17519 opened May 1, 2025 by simon-mo Loading…
2
[Bugfix][Model] vllm-v0 engine run eagle algo with qwen2.5 model, KeyError: 'norm.weight' bugfix
#17518 opened May 1, 2025 by Greatpanc Loading…
1
1
[Bugfix][V1][Spec Dec] Add generator to request even when no seed is provided. speculative-decoding v1
#17509 opened May 1, 2025 by luyuzhe111 Loading…
6
[BugFix] Qwen3 tool calling failed using qwen3 reasoning parser. documentation Improvements or additions to documentation frontend tool-calling
#17506 opened Apr 30, 2025 by Xu-Wenqing Loading…
10
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.
X