Kangyan-Zhou
|
d134096319
|
Add Deepseek models into nightly tests (#12865)
|
2025-11-09 13:17:49 +08:00 |
|
Qiaolin Yu
|
f290e8016e
|
Revert "Fix spec decoding acc length for dpsk-r1-fp4 tp8" (#12900)
|
2025-11-08 20:42:42 -08:00 |
|
Qiaolin Yu
|
9299a62fcb
|
Fix spec decoding acc length for dpsk-r1-fp4 tp8 (#12896)
|
2025-11-08 19:55:45 -08:00 |
|
Liangsheng Yin
|
49543be9da
|
Tiny simplify can_run_dp_cuda_graph gather logic (#12891)
|
2025-11-09 11:15:36 +08:00 |
|
alisonshao
|
d3a03aeef8
|
Refs/heads/add nightly test multi gpu configs (#12870)
|
2025-11-08 15:14:50 -08:00 |
|
Baizhou Zhang
|
5f02b918ec
|
[Fix] Fix trtllm-mla backend when chunked prefix cache is disabled (#12361)
|
2025-11-08 15:10:25 -08:00 |
|
b8zhong
|
49653c8896
|
use fast stream instead of torch.cuda.current_stream in llama 4 shared experts overlap (#12811)
|
2025-11-08 15:04:37 -08:00 |
|
fzyzcjy
|
2b6c4257a0
|
Fix sending all requests to the first rank in DP attention (#12832)
|
2025-11-09 00:18:53 +08:00 |
|
Liangsheng Yin
|
243ea585fc
|
[DP-Attn] Clarify MLP sync / idle batch preparation logic (#12843)
|
2025-11-08 23:23:14 +08:00 |
|
Charles Chen
|
f1a9c72de3
|
Support capturing aux_hidden_states for minimax m2. (#12798)
|
2025-11-08 01:54:22 -08:00 |
|
Lianmin Zheng
|
0296f1cdad
|
[Auto Sync] Update activation.py, logits_processor.py, rota... (20251107) (#12853)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-07 22:07:51 -08:00 |
|
Rain Jiang
|
0f76976c3c
|
remove the fa4 page_size hardcode to 128 restriction on mla model arch (#12801)
|
2025-11-07 13:30:30 -08:00 |
|
Lianmin Zheng
|
ae62279071
|
Fix data parallel controller launch for num nodes > 2 (#12822)
|
2025-11-07 12:13:21 -08:00 |
|
Mick
|
e316bcacb1
|
update multimodal_gen readme (#12825)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-11-07 09:04:44 -08:00 |
|
Yang Kaiyong
|
61bfd9fa9b
|
optm(checkpoint-engine): disable multi-thread loading when update weights (#12374)
Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
|
2025-11-07 21:30:04 +08:00 |
|
Chen1022
|
c67fce160e
|
Fix missing dp_max_padding argument in set_dp_buffer_len (#12812)
|
2025-11-07 21:27:43 +08:00 |
|
hlu1
|
bef37d6de8
|
[Deepseek V3.2] Only skip Indexer logits computation when is_extend_without_speculative (#12816)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-11-07 01:34:04 -08:00 |
|
Jonah Bernard
|
bc25ea6762
|
[MoE] Add Comprehensive MoE Integration Tests (#12090)
|
2025-11-07 00:34:46 -08:00 |
|
elvischenv
|
1fa788ec14
|
[Bugfix] Fix illegal memory access (#12758)
|
2025-11-06 21:59:57 -08:00 |
|
Johnsonms
|
125f76ea44
|
[Test] Add DeepSeekV3.2 NSA Indexer Test Suite (#12520)
|
2025-11-06 21:28:43 -08:00 |
|
Yuhao Yang
|
d8736c756a
|
fix multimodal gen issues (#12765)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-07 13:19:49 +08:00 |
|
Tianyu Guo
|
0ee5ab5a74
|
Add PP support for dots_vlm (#12763)
|
2025-11-06 19:14:27 -08:00 |
|
hzh0425
|
ed5e905c89
|
[HotFix]: Add missing SGLANG_EPLB_HEATMAP_COLLECTION_INTERVAL env var (#12776)
|
2025-11-06 18:58:44 -08:00 |
|
hzh0425
|
d9c812d881
|
[hotfix]: Resolve ModuleNotFoundError in PD deployment for is_in_ci() (#12772)
|
2025-11-06 18:48:03 -08:00 |
|
YAMY
|
7257525cce
|
[DeepSeek-V3.2][NSA] Enable MHA Pathway for Short Sequence Prefill on B200 (SM100) (#12788)
|
2025-11-06 17:26:08 -08:00 |
|
Gaurav Verma
|
34ba10efd6
|
[AMD] Update wave-lang to 3.8.2 (#12576)
Signed-off-by: xintin <gaurav.verma@amd.com>
|
2025-11-06 15:51:44 -08:00 |
|
Rain Jiang
|
a119363f08
|
ignore the deepgemm check when the model weight with nvfp4 and moe ba… (#12782)
|
2025-11-06 15:27:28 -08:00 |
|
Nicolas Castet
|
3a64844a1c
|
Fix hang in deepgemm compilation with symmetric memory enabled (#12715)
|
2025-11-06 14:06:22 -08:00 |
|
Lee Nau
|
b0d1c21d03
|
[fix] Only enable flashinfer all reduce fusion by default for single-node servers (#12724)
|
2025-11-06 11:53:58 -08:00 |
|
R0CKSTAR
|
b07c5e4080
|
Pin uvloop to 0.21.0 (#12279)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
|
2025-11-07 03:33:31 +08:00 |
|
jianan-gu
|
6e6009fb6b
|
[CPU] Fix TP padding case with weight block size (#8243)
|
2025-11-07 03:24:48 +08:00 |
|
Jimmy
|
88a2a34041
|
[Fix]HTTP Stream raise exception (#11904)
|
2025-11-07 03:23:12 +08:00 |
|
Teng Ma
|
78c58621d2
|
[mem pool] bugfix: wrong position for self.device in Mamba (#12684)
|
2025-11-07 03:05:42 +08:00 |
|
gaopengff
|
4e234b4cf9
|
[Intel XPU]Update pytorch xpu to 2.9 (#12363)
|
2025-11-06 10:34:23 -08:00 |
|
gaopengff
|
4cc725ac1c
|
[Intel]Add 'intel_xpu' attention backend for llama4 (#11051)
|
2025-11-06 10:33:41 -08:00 |
|
sglang-bot
|
0c006b8809
|
chore: bump SGLang version to 0.5.5 (#12739)
|
2025-11-07 00:46:19 +08:00 |
|
Ke Bao
|
cd135bfe30
|
Update dsv3 quantization auto setting for sm100 (#12778)
|
2025-11-06 22:39:13 +08:00 |
|
jiapingW
|
0da30dbc20
|
fix qwen3-omni audio length < 30s (#12674)
Co-authored-by: canghua <canghua.wjp@alibaba-inc.com>
|
2025-11-06 00:05:28 -08:00 |
|
yinghui
|
58095cb00a
|
Add timing metrics for requests (#12646)
Co-authored-by: Scott Lee <scottjlee@users.noreply.github.com>
|
2025-11-05 23:07:16 -08:00 |
|
Yuan Luo
|
fd3034da75
|
[VLM] Optimize qwen_vl preprocess_video (#12240)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
|
2025-11-06 14:55:01 +08:00 |
|
Binyao Jiang
|
fbbe16faab
|
[GDN] Fuse b.sigmoid(), fused_gdn_gating and unsqueeze into one kernel: up to 0.85% e2e speedup (#12508)
|
2025-11-05 22:52:04 -08:00 |
|
Yi Zhang
|
6a1a64fa41
|
[BUGFIX] fix output_ids in abort (#12737)
|
2025-11-05 22:51:47 -08:00 |
|
Yi Zhang
|
e2715cf871
|
fix mamba prefix cache leak caused by abort (#12693)
|
2025-11-05 22:51:03 -08:00 |
|
Mick
|
73e9a2ef5c
|
fix: tiny fix cli (#12744)
|
2025-11-06 14:45:50 +08:00 |
|
Atream
|
2104d20eba
|
Temporarily fix missing routed_scaling_factor for CompressedTensorsWNA16MoEMethod (#12738)
|
2025-11-06 12:01:03 +08:00 |
|
YAMY
|
f235498eca
|
DeepSeek-V3.2: Add Adaptive MHA Attention Pathway for Short-Sequence Prefill (#11892)
|
2025-11-05 19:33:26 -08:00 |
|
gongwei-130
|
97be66c358
|
fix sgl-kernel version (#12723)
|
2025-11-05 19:01:03 -08:00 |
|
Lianmin Zheng
|
c7d57d5bb3
|
Fix CI and style (#12658)
|
2025-11-05 15:08:15 -08:00 |
|
Kaixi Hou
|
141278048e
|
[NVIDIA] Fix unit test of MoE and add it to nightly ci (#12709)
|
2025-11-05 14:33:18 -08:00 |
|
Shu Wang
|
82f39dc11d
|
Add mm_fp4 trtllm backend (#12406)
|
2025-11-05 14:31:46 -08:00 |
|