Skip to content

Pull requests: vllm-project/vllm

New pull request New
317 Open 2,405 Closed
317 Open 2,405 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[ Doc ] Update README to highlight activation quantization
#6476 opened Jul 16, 2024 by robertgshaw2-neuralmagic Loading…
2
[Misc][Speculative decoding] Typos and typing fixes ready
#6467 opened Jul 16, 2024 by ShangmingCai Loading…
3
[Bugfix][Frontend] Fix missing /metrics endpoint
#6463 opened Jul 16, 2024 by DarkLight1337 Loading…
1
2
[CI/Build] Remove "boardwalk" image asset ready
#6460 opened Jul 16, 2024 by DarkLight1337 Loading…
1
[Hardware][TPU] Support MoE with Pallas GMM kernel tpu Related to Google TPUs
#6457 opened Jul 16, 2024 by WoosukKwon Loading…
1
[Bugfix] enable prefix caching for AsyncLLMEngine when requesting prompt_logprobs
#6456 opened Jul 15, 2024 by KrishnaM251 Loading…
1
1
[Distributed][Model] Rank-based Component Creation for Pipeline Parallelism Memory Optimization
#6455 opened Jul 15, 2024 by wushidonguc Loading…
7
[Misc] Log spec decode metrics ready
#6454 opened Jul 15, 2024 by comaniac Loading…
7
[Model] H2O Danube3 Collection
#6451 opened Jul 15, 2024 by g-eoj • Draft
1
[Not for review] PP ADAG
#6448 opened Jul 15, 2024 by ruisearch42 • Draft
1
[Core] Use numpy to speed up padded token processing ready
#6442 opened Jul 15, 2024 by peng1999 Loading…
7
[Draft] proposal for ipex quant support
#6440 opened Jul 15, 2024 by jikunshang • Draft
3
[Doc][CI/Build] Update docs and tests to use vllm serve
#6431 opened Jul 15, 2024 by DarkLight1337 Loading…
5
[ Kernel ] AWQ Fused MoE
#6422 opened Jul 14, 2024 by robertgshaw2-neuralmagic • Draft
2
[Doc] Add documentations for nightly benchmarks
#6412 opened Jul 13, 2024 by KuntaiDu Loading…
12
[ci][distributed] add pipeline parallel correctness test ready
#6410 opened Jul 13, 2024 by youkaichao Loading…
6
[Model] Pipeline parallel support for Mixtral
#6403 opened Jul 13, 2024 by binxuan Loading…
3
[Misc][WIP] Disambiguate quantized types via a new ScalarType
#6396 opened Jul 12, 2024 by LucasWilkinson • Draft
3 tasks
1
torch.compile based model optimizer
#6377 opened Jul 12, 2024 by bnellnm • Draft
[BUGFIX] Raise an error for no draft token case when draft_tp>1 ready
#6369 opened Jul 12, 2024 by wooyeonlee0 Loading…
8
[ Misc ] Support Act Order in Compressed Tensors
#6358 opened Jul 12, 2024 by robertgshaw2-neuralmagic • Draft
1
Fix the lm_head in gptbigcode in lora mode
#6357 opened Jul 12, 2024 by maxdebayser Loading…
11
[Bugfix] Fix Ray Metrics API usage
#6354 opened Jul 11, 2024 by Yard1 Loading…
7
[Kernel] Fix identical branches
#6344 opened Jul 11, 2024 by stevegrubb Loading…
1
2
[Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step
#6338 opened Jul 11, 2024 by alexm-neuralmagic Loading…
56
ProTip! What’s not been updated in a month: updated:<2024-06-16.