Skip to content

Pull requests: NVIDIA/TensorRT-LLM

New pull request New
273 Open 2,329 Closed
273 Open 2,329 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[DON'T MERGE] NGram V2 test
#5401 opened Jun 23, 2025 by wili-65535 • Draft
2
test: [CI] remove closed bugs
#5400 opened Jun 22, 2025 by xinhe-nv Loading…
remove libnuma conan dependency
#5399 opened Jun 22, 2025 by dongxuy04 Loading…
3
Add sleep function for disagg gen-only benchmarking
#5398 opened Jun 22, 2025 by qiaoxj07 Loading…
3
test: add support for DGX B200 with 8 GPUs in L0 tests
#5397 opened Jun 21, 2025 by yizhang-nv Loading…
6
[1/N][TRTLLM-5195][feat] Share PyTorch tensor between processes
#5396 opened Jun 21, 2025 by chang-l Loading…
6
[TRTLLM-6019] feat: Remove cutlass min latency code from AutoTuner.
#5394 opened Jun 21, 2025 by hyukn Loading…
6
feat: Remove not used padding_idx in models
#5385 opened Jun 20, 2025 by HuiGao-NV Loading…
6
refactor: remove batch_manager::KvCacheConfig and use executor::KvCacheConfig instead
#5384 opened Jun 20, 2025 by Funatiq • Draft
15
Detokenize option in /v1/completions request Community Engagement help/insights needed from community Community want to contribute PRs initiated from Community
#5382 opened Jun 20, 2025 by Wokzy Loading…
Fix: missing clientId when serialize and deserialize response (cherry-pick #5231)
#5378 opened Jun 20, 2025 by kaiyux Loading…
3
[TRTLLM-5831][feat] Add LoRA support for pytorch backend in trtllm-serve
#5376 opened Jun 19, 2025 by talorabr Loading…
chore: Add scripts to profile cutlass moe
#5375 opened Jun 19, 2025 by bobboli • Draft
Fix permission for local user issues in NGC docker container.
#5373 opened Jun 19, 2025 by MartinMarciniszyn Loading…
@MartinMarciniszyn
3
Feat/unify checkpoints loading
#5372 opened Jun 19, 2025 by shaharmor98 • Draft
[TRTLLM-5838][fix] fix max batch size and max tokens in kv cache estimations for Nemotron-H
#5371 opened Jun 19, 2025 by tomeras91 Loading…
14
fix: fix bug of qwen3 + eagle3 + finalize_moe_fusion
#5369 opened Jun 19, 2025 by byshiue Loading…
3
Mxfp4 moe
#5367 opened Jun 19, 2025 by Tracin Loading…
tests: update benchmark test lists
#5365 opened Jun 19, 2025 by xinhe-nv Loading…
4
feat: TRTLLM-5941 Upgrade xgrammar to 0.1.18
#5364 opened Jun 19, 2025 by Wanli-Jiang • Draft
7
Make moe permute and final as custom op
#5358 opened Jun 19, 2025 by limin2021 Loading…
1
feat(openai protocol):support logitbias
#5354 opened Jun 19, 2025 by xq25478 Loading…
feat(eagle):support qwen in eagle1/2
#5352 opened Jun 19, 2025 by xq25478 Loading…
feat(model):support qwen3 dense in trt flow
#5350 opened Jun 19, 2025 by xq25478 Loading…
1
test: Add LLGuidance test and refine guided decoding
#5348 opened Jun 19, 2025 by syuoni Loading…
@syuoni
20
ProTip! Adding no:label will show everything without a label.