fzyzcjy
|
45cf575852
|
Fix overlap scheduler not take effect when outputing logprobs (#14096)
|
2025-11-28 18:15:56 +08:00 |
|
Mick
|
0e8ce1e832
|
[diffusion] refactor: clean useless files (#14094)
|
2025-11-28 18:14:00 +08:00 |
|
Lzhang-hub
|
ea1e9f6b3c
|
feat: support qwen3_vl vision model dp (#13724)
|
2025-11-28 17:29:07 +08:00 |
|
Lzhang-hub
|
f6e37d3edb
|
[Bugfix] qwen2.5-vl spec decode accept_len low (#13904)
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
|
2025-11-28 17:26:32 +08:00 |
|
vipwangerxiao
|
ab9a46d462
|
Support configuring the request limit per receiving poll (#14076)
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com>
Co-authored-by: Feng Su <225349073+sufeng-buaa@users.noreply.github.com>
|
2025-11-28 16:14:21 +08:00 |
|
shuwenn
|
621061f017
|
[Bugfix] input prompt was not logged (#13936)
|
2025-11-28 16:00:51 +08:00 |
|
Aleksandr Krotov
|
7daddcdb58
|
Fix structural_tag tool call with null schema (#14006)
|
2025-11-27 23:04:16 -08:00 |
|
Mick
|
951028968c
|
[diffusion] refactor: refactor ComponentLoader and support loading native models from diffusers and transformers (#13205)
|
2025-11-28 14:17:32 +08:00 |
|
Mick
|
3543a04a48
|
[diffusion] refactor: refactor condition image resize logic (#14079)
|
2025-11-28 14:06:34 +08:00 |
|
fzyzcjy
|
21af8e73ad
|
Super tiny add comments to SGLANG_DEEPEP_NUM_MAX_DISPATCH_TOKENS_PER_RANK (#14048)
|
2025-11-27 22:16:43 +08:00 |
|
Baizhou Zhang
|
7ab548ef64
|
[2/2] Refactor DeepGeem requant for FP8 FusedMoE on Blackwell (#13960)
|
2025-11-27 09:00:26 -05:00 |
|
Yixin Dong
|
6350042696
|
feat: Naive support Spec V2 + Constrained Decoding (#13425)
Signed-off-by: Ubospica <ubospica@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-11-27 20:31:46 +08:00 |
|
fzyzcjy
|
25758647b1
|
Support sanity checking weight consistency especially for RL (#13854)
|
2025-11-27 20:25:12 +08:00 |
|
fzyzcjy
|
2bc8ee8b74
|
Tiny support 3D tensors in inverse_transform_scale_ue8m0 (#14002)
|
2025-11-27 20:20:45 +08:00 |
|
Jimmy
|
ab843ced31
|
[Feat]Add scheduler recv skipper weights to environment configuration (#13855)
|
2025-11-27 18:16:11 +08:00 |
|
Mick
|
6edffc6391
|
[diffusion] perf: improve black-forest-labs/FLUX.2-dev (#14040)
|
2025-11-27 14:49:52 +08:00 |
|
gaopengff
|
077ca70ee4
|
[Intel XPU]Add xpu support for get_device_memory_capacity (#13895)
|
2025-11-26 20:55:52 -08:00 |
|
Qiaolin Yu
|
7cb04dc0e5
|
Use trtllm mha decode kernel for target_verify in speculative decoding (#13976)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-11-26 20:40:34 -08:00 |
|
sunxxuns
|
5443db8759
|
fix: Fix AMD CI failures with HIP layernorm and PyPI connectivity (#13814)
Co-authored-by: root <root@mi300x8-005.atl1.do.cpe.ice.amd.com>
|
2025-11-27 11:30:37 +08:00 |
|
Stefan He
|
9f340ab1fb
|
[Piecewise] support disable decode cuda graph when enable piecewise cuda graph (#13965)
|
2025-11-26 18:35:59 -08:00 |
|
alisonshao
|
6330d6641b
|
Fix flashinfer cutlass MoE output shape for non-FP4-packed inputs (#14028)
|
2025-11-26 18:09:02 -07:00 |
|
Sam
|
91e8dc371a
|
[Feat][NVFP4] Enable NVFP4 MoE for Qwen series models (eg. Qwen3-Next) #13761 (#13761)
Co-authored-by: Kaixi Hou <kaixih@nvidia.com>
|
2025-11-26 17:53:45 -07:00 |
|
Lianmin Zheng
|
231df4b0d4
|
Cleanup server args (#14027)
|
2025-11-26 16:32:41 -08:00 |
|
ShawnY112358
|
5155016b56
|
[feat] update bucketed weights from distributed (#13824)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-26 15:30:45 -08:00 |
|
Netanel Haber
|
082b54c689
|
Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277)
|
2025-11-26 16:28:52 -07:00 |
|
mrhaoxx
|
15ff6982b9
|
Support KTransformers for Qwen3-VL moe (#13983)
|
2025-11-26 14:59:15 -08:00 |
|
alisonshao
|
9adef42c60
|
Fix nightly test failure: CPP radix cache init (#14018)
|
2025-11-26 14:58:26 -08:00 |
|
Tianhao Zhou
|
685b9d82bd
|
fix: cuda graph issue while running longcat_flash (#14007)
|
2025-11-26 14:57:22 -08:00 |
|
alisonshao
|
a223402ffb
|
Add adapter_model.safetensors to corruption validation for LoRA (#14022)
|
2025-11-26 14:52:46 -08:00 |
|
Douglas Yang
|
697a77bf73
|
Add stress test workflow (#13937)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2025-11-26 13:24:39 -08:00 |
|
Lianmin Zheng
|
0a186924ba
|
[Code sync] Fix registration of some ops in grok & Fix oss sync scripts (#13990)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-26 13:11:52 -08:00 |
|
Baizhou Zhang
|
8a9b8b8457
|
Revert "Fix nightly test failures: NSA indexer dtype and CPP radix cache init" (#14015)
|
2025-11-26 10:45:23 -08:00 |
|
Netanel Haber
|
8308cd3632
|
Support internvl on Blackwell (which doesn't support fa3): add SingletonCache support to Vision{Sdpa|Triton|Ascend}Attention (#13151)
|
2025-11-26 10:31:45 -08:00 |
|
Da Chen
|
e0e8a99630
|
fix: correct usage of minimax-m2 deepep moe forward (#13892)
Co-authored-by: Dash <dash@minimaxi.com>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
|
2025-11-26 10:01:23 -08:00 |
|
Mick
|
5102d00901
|
[diffusion] model: support black-forest-labs/FLUX.2-dev (#14000)
|
2025-11-27 01:49:40 +08:00 |
|
Vedant V Jhaveri
|
9dab534b35
|
fix spec dec request level metrics (#13754)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-11-27 01:09:21 +08:00 |
|
Michelle Wu
|
262c3c1fde
|
[Ascend] Support enable-mixed-chunk in non-MLA scenarios (#12491)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-11-27 00:00:21 +08:00 |
|
Liangsheng Yin
|
6c190cbda0
|
Rename: --hooks to --forward-hooks (#13994)
|
2025-11-26 22:26:28 +08:00 |
|
Liangsheng Yin
|
eff6a07c8f
|
Fix get_load API (#13991)
|
2025-11-26 22:07:51 +08:00 |
|
Shangming Cai
|
b704b0a922
|
Optimize uneven PP layer distribution logic to improve PP performance (#13977)
|
2025-11-26 22:05:03 +08:00 |
|
vipwangerxiao
|
15729dbc8e
|
Use dynamically maintained num_waiting_tokens in get_load() (#13203)
Signed-off-by: Peng Wang <peng_wang@linux.alibaba.com>
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com>
|
2025-11-26 20:34:45 +08:00 |
|
Zehuan Li
|
21b0582d4b
|
[feature] Initial block diffusion language model support (#12588)
Co-authored-by: Tiwei Bie <tiwei.btw@antgroup.com>
|
2025-11-26 17:57:54 +08:00 |
|
Yuhao Yang
|
5795da5e83
|
[diffusion] fix: fix the issue where the qwen-edit & wan model produces incorrect output during sequence parallelism (#13922)
|
2025-11-26 15:58:23 +08:00 |
|
StonyPort
|
540d6fee20
|
Support piecewise CUDA graph for embedding models (#13852)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
|
2025-11-26 15:29:46 +08:00 |
|
ShawnY112358
|
007c3e234c
|
[feat] support in-flight weight update (#10071)
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
|
2025-11-25 22:03:13 -08:00 |
|
fzyzcjy
|
7130ad3a29
|
Fix SGLANG_ENABLE_HEALTH_ENDPOINT_GENERATION not working (#13961)
|
2025-11-25 21:58:55 -08:00 |
|
alisonshao
|
846ba3c62c
|
Fix nightly test failures: NSA indexer dtype and CPP radix cache init (#13958)
|
2025-11-26 11:52:08 +08:00 |
|
Yubo Wang
|
18fb51583f
|
Support FlashAttention3 page_size > 1 and topk > 1 case with paged attn and spec decode (#7725)
|
2025-11-26 11:44:41 +08:00 |
|
Yuan Luo
|
ca5c8b16f6
|
[VLM] Support InternVL Vision Encoder Data Parallelism (#13925)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-11-26 11:43:05 +08:00 |
|
timmy-feng
|
f33e5d1ef1
|
fix: spec overlap predict shape does not match verify output shapes (#12786)
|
2025-11-26 11:01:06 +08:00 |
|