hlu1
|
618ca23802
|
[Deepseek] Refactor deepseek server_args _handle_model_specific_adjustments (#13687)
|
2025-11-23 12:41:14 -08:00 |
|
Liangsheng Yin
|
5c2915494c
|
[Scheduler] Tiny organize code style (#13806)
|
2025-11-23 23:41:34 +08:00 |
|
Mick
|
dd70cf99c1
|
[diffusion] CI: add run_suite to multimodal_gen CI (#13791)
|
2025-11-23 21:27:33 +08:00 |
|
Mick
|
d4593964fe
|
[diffusion] feat: support sp for image models (#13180)
|
2025-11-23 18:11:42 +08:00 |
|
Xiaoyu Zhang
|
b964ce61d6
|
[DeepEP] Add SGLANG_DEEPEP_BF16_DISPATCH env var in Normal mode (#13787)
|
2025-11-23 17:32:43 +08:00 |
|
DarkSharpness
|
ac5505b04c
|
[Feature] HiCache JIT kernel (once again) (#13764)
|
2025-11-22 22:19:16 -08:00 |
|
ErsongWang
|
047935080d
|
Revert "Fix RMSNorm API CALL mismatch issue. (#10032)" (#13727)
|
2025-11-22 14:25:52 -08:00 |
|
cctry
|
cad7878964
|
Gather static input buffers for cuda graph (#13676)
|
2025-11-22 13:01:50 -08:00 |
|
Binyao Jiang
|
b29769f3b6
|
Move unnecessary input_addr capture under debug mode flag for speed-up (#13690)
|
2025-11-22 11:42:26 -08:00 |
|
Ho-Ren (Jack) Chuang
|
3990b84bd3
|
Refactor MHA & MLA KV caches to support FP4 (#13547)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
|
2025-11-22 11:13:43 -08:00 |
|
yinghui
|
5a4394a342
|
align code style eagle draft&draft_extend cuda graph runner (#13533)
|
2025-11-23 01:55:16 +08:00 |
|
Yuhao Yang
|
dd303614e0
|
[diffusion] CI: tinyfix diffusion ci (#13769)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-23 01:03:36 +08:00 |
|
Liangsheng Yin
|
863124684c
|
[Spec v2] Remove allocate_lens and enable over-allocation (#13478)
|
2025-11-22 22:49:10 +08:00 |
|
Yuan Luo
|
5625e32cae
|
[VLM] Replace torch.repeat_interleave with faster np.repeat for Qwen-VL series (#13736)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-11-22 22:45:32 +08:00 |
|
Mick
|
ca548d8324
|
[diffusion] refactor: refactor sampling params (#13706)
|
2025-11-22 22:43:04 +08:00 |
|
Liangsheng Yin
|
3397bcee84
|
Tiny support different prompts in send_one.py (#13768)
|
2025-11-22 21:59:58 +08:00 |
|
Liangsheng Yin
|
3e804bb0ba
|
Update mem checker during busy (#13704)
|
2025-11-22 21:15:02 +08:00 |
|
Yuhao Yang
|
a22de641ef
|
[diffusion] fix: fix hunyuanvideo and add 2-gpu ci test (#13720)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-22 20:54:51 +08:00 |
|
Liangsheng Yin
|
ac43822634
|
Refactor eagle bigram key matching (#13714)
|
2025-11-22 20:40:42 +08:00 |
|
Yijie Zhu
|
a92afb00c6
|
[Ascend] support Kimi-K2-Thinking (#12759)
Co-authored-by: ZhengdQin <zhengdqin@gmail.com>
Co-authored-by: richhuan <huan_rz@qq.com>
Co-authored-by: ZhengdQin <46387172+ZhengdQin@users.noreply.github.com>
|
2025-11-22 17:33:07 +08:00 |
|
Trevor Morris
|
0eea17e3b5
|
Use dual stream for DS MoE whenever cuda graph is used (instead of with token threshold) (#9405)
|
2025-11-22 00:37:41 -08:00 |
|
Netanel Haber
|
3805243245
|
modularize gsm8k and mmmu test classes (#13506)
|
2025-11-22 16:06:53 +08:00 |
|
Baizhou Zhang
|
8bfce9b08d
|
[Tiny] Renaming environ for NVFP4 dispatch (#13756)
|
2025-11-22 00:05:20 -08:00 |
|
Lianmin Zheng
|
b41afa3754
|
[Auto Sync] Update evict_policy.py, radix_cache.py (20251120) (#13669)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
|
2025-11-21 22:07:36 -08:00 |
|
alisonshao
|
94ae816f29
|
Fix model weights validation with automatic cache cleanup (#13729)
|
2025-11-22 11:40:00 +08:00 |
|
Kangyan-Zhou
|
59b4d7f8d6
|
Fix B200 Nightly tests and move one manual test back to unit test to prevent the same issue (#13746)
|
2025-11-21 17:41:12 -08:00 |
|
Shu Wang
|
a56f770277
|
Fix global scaling factor loading hang (#13484)
|
2025-11-21 16:07:06 -08:00 |
|
roikoren755
|
1b48e1b974
|
Feat/nemotron nano v3 support (#12690)
|
2025-11-21 13:53:05 -08:00 |
|
Qiaolin Yu
|
681b9e6425
|
Revert "enable csgmv automatically on cuda" (#13707)
|
2025-11-21 10:37:41 -08:00 |
|
b8zhong
|
85ffce30af
|
[Piecewise CUDA Graph] Support Kimi-K2 (non-Thinking) (#13466)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-11-21 09:39:59 -08:00 |
|
Mick
|
aa6e2c8aa0
|
[diffusion] log: minor improve logging (#13735)
|
2025-11-21 23:01:23 +08:00 |
|
weibingo
|
dc836909a6
|
fix 3fs down, lock schedule main thread (#13407)
|
2025-11-21 03:02:36 -08:00 |
|
Mick
|
323fed5cfd
|
[diffusion] doc: add contributing.md (#13649)
|
2025-11-21 19:00:27 +08:00 |
|
jacky.cheng
|
eff7df6d0a
|
[AMD] Enable fused shared expert append and flatten quant for fp8 deepseekR1 model (#13705)
Co-authored-by: yctseng0211 <yctseng@amd.com>
|
2025-11-21 02:48:28 -08:00 |
|
Mick
|
5e7f91d451
|
[diffusion] profile: support performance metric dumping and comparison (#13630)
|
2025-11-21 18:47:16 +08:00 |
|
Xiaoyu Zhang
|
a34d3abb54
|
[Clean code] Compressed_tensors_moe code clean (#13719)
|
2025-11-21 18:15:46 +08:00 |
|
Cheng Wan
|
6d0e0b9bfc
|
[11/N] MoE Refactor: Simplifying SBO Implementation with Dispatcher Hooks (#13327)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-11-21 01:11:37 -08:00 |
|
Even Zhou
|
589d9ad55b
|
[NPU] chore: bump to CANN 8.3.RC1 and Pytorch 2.8.0 (#13647)
|
2025-11-21 17:07:08 +08:00 |
|
Ziming Huang
|
a244c0309c
|
[Fix] Qwen3Next lmhead dtype (#13708)
|
2025-11-21 16:01:33 +08:00 |
|
Teng Ma
|
1bb063aac8
|
[HiCache] fix unit test with changed new APIs (#13498)
|
2025-11-21 15:40:31 +08:00 |
|
Michele Marzollo
|
b30f63c40f
|
[Bugfix] Fix hidden state size in EAGLE PD disaggregation buffers (#13590)
Co-authored-by: ZeldaHuang <hzm414167@alibaba-inc.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-11-21 15:32:40 +08:00 |
|
Lianmin Zheng
|
90a0133515
|
[Auto Sync] Update http_server.py, io_struct.py, scheduler_... (20251120) (#13679)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Zhuqi Li <zhli@x.ai>
|
2025-11-20 23:17:15 -08:00 |
|
zyksir
|
4360279036
|
[diffusion] server: use meta to avoid Linear init for TextEncoder (#13564)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-21 15:14:24 +08:00 |
|
ishandhanani
|
b537ac0d1f
|
Fix ZMQ bind error on non-zero rank nodes when using SGLANG_BLOCK_NONZERO_RANK_CHILDREN=0 (#13686)
|
2025-11-20 22:54:41 -08:00 |
|
Mick
|
eda2f70033
|
[diffusion] doc: minor update docs (#13177)
|
2025-11-21 14:35:29 +08:00 |
|
Yuhao Yang
|
8c212a2029
|
[difusion] CI: speed up multimodal_gen ci (#13665)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-21 14:26:33 +08:00 |
|
Stefan He
|
d754ce973e
|
[Piecewise Cuda Graph] rename, refactor and add more logging (#13675)
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Ke Bao <ISPObaoke@163.com>
Co-authored-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2025-11-21 13:28:38 +08:00 |
|
Yuan Luo
|
475962a139
|
[VLM] Support Piecewise CUDA Graph for InternVL (#13640)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-11-21 13:21:51 +08:00 |
|
Xiaoyu Zhang
|
bfcf15a129
|
[opt kimi k2 4 / n] Delete useless pad kernel in sgl_moe_align_block_size (#13587)
|
2025-11-21 13:16:42 +08:00 |
|
Xiaoyu Zhang
|
fb04d43428
|
[kimi k2 thinking] Avoid useless torch.zeros_ (#13596)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-11-21 13:15:27 +08:00 |
|