Lianmin Zheng
|
d646cf6347
|
[Auto Sync] Update test_deterministic.py (20251112) (#13128)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-12 11:12:23 -08:00 |
|
Ke Bao
|
4edb240112
|
Fuse routed_scaling_factor to fused_marlin_moe (#12998)
|
2025-11-13 00:18:58 +08:00 |
|
Yuan Luo
|
706502ff6c
|
[VLM] Support PP for Qwen2.5-VL (#13075)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
|
2025-11-12 23:18:44 +08:00 |
|
Makcum888e
|
c2e56dadb2
|
[Ascend] torch_npu.npu_mrope for MRotaryEmbedding (#10907)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
|
2025-11-12 21:45:54 +08:00 |
|
Zhihao Zhang
|
9c1c5c6d7d
|
[ngram] use SGLANG_NGRAM_FORCE_GREEDY_VERIFY to control verify method (#13153)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
|
2025-11-12 21:07:33 +08:00 |
|
khalilzhk
|
2d531946db
|
[Ascend][feature] support L1+ L2 radixcache on ascend (#12214)
Co-authored-by: khalilzhk <zhangkaikai12@huawei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2025-11-12 20:45:24 +08:00 |
|
sglang-bot
|
ebaf86d441
|
chore: bump SGLang version to 0.5.5.post2 (#13129)
Include the critical fix https://github.com/sgl-project/sglang/pull/12915.
|
2025-11-12 20:35:20 +08:00 |
|
zhanghaotong
|
8359f185a1
|
[Feature] Propagate Trace Headers into Root Span for OpenTelemetry Cross-Service Context (#10808)
Signed-off-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
|
2025-11-12 20:28:59 +08:00 |
|
ronnie_zheng
|
5324f37ab3
|
[Ascend]adapt enable-profile-cuda-graph for NPU (#12617)
Co-authored-by: Leo920320 <1530593013@qq.com>
Co-authored-by: liupengcheng <6531487+leo920320@user.noreply.gitee.com>
|
2025-11-12 19:57:24 +08:00 |
|
Charlie Ruan
|
2864c49fbc
|
[RPC] Fix handle_rpc_request with **recv_req.parameters (#7906)
|
2025-11-12 19:29:12 +08:00 |
|
Yikai Zhang
|
9c546bfd6d
|
Fix the Wrong Return Type of Scheduler.recv_requests (#7886)
|
2025-11-12 18:54:56 +08:00 |
|
Rohan Potdar
|
c9b581644d
|
Dump total_throughput to output-file in bench_serving.py (#9790)
|
2025-11-12 18:48:28 +08:00 |
|
SijiaYang
|
ffeb28ba6f
|
fix: duplicate resize images logic of qwen-vl series models (#12458)
Signed-off-by: yangsijia.614 <yangsijia.614@bytedance.com>
|
2025-11-12 18:08:40 +08:00 |
|
Jimmy
|
b40f605fde
|
fix(tcp-port): replace bind_server_socket to get_zmq_socket(Port conflict) (#11961)
Co-authored-by: wangchao <wcsjtu@163.com>
|
2025-11-12 18:05:16 +08:00 |
|
Xinyuan Tong
|
4983b7e7aa
|
Fix strict level setting for Kimi K2 tool calls when not explicitly set (#13077)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-11-12 00:01:42 -08:00 |
|
wxsm
|
f825137f8a
|
fix: Remove dupulicated kv_events initialization in scheduler (#13132)
|
2025-11-11 23:54:47 -08:00 |
|
Teng Ma
|
44e391b6e9
|
[PD] Add custom gpu id to device topo support (#12817)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-11-12 15:00:45 +08:00 |
|
ishandhanani
|
1a5c313f97
|
feat(engine): add rid parameter to methods in Engine class (#13095)
|
2025-11-11 22:37:54 -08:00 |
|
Qi Yuhang
|
7ea5b42d70
|
[sgl-kernel][5/N]Support Expert Specialization Grouped GEMM (#12666)
Co-authored-by: Fan Yin <1106310035@qq.com>
|
2025-11-11 21:23:25 -08:00 |
|
zhanghaotong
|
5ded5e2729
|
[Feature] Trace: Support http/protobuf span exporter protocol (#12396)
Signed-off-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
|
2025-11-12 05:16:43 +00:00 |
|
Mick
|
33d1aeb07f
|
diffusion: refactor task type of models (#13118)
|
2025-11-12 12:39:34 +08:00 |
|
Mick
|
60cb716720
|
[diffusion] log: improve logging while multiprocessing (#12997)
|
2025-11-12 12:08:37 +08:00 |
|
Trevor Morris
|
151e13687a
|
Don't fuse wk+weight_proj for nextn (#12863)
|
2025-11-11 20:02:52 -08:00 |
|
Mick
|
2f9952cdbf
|
diffusion: remove unused workflows folder (#13114)
|
2025-11-12 11:51:24 +08:00 |
|
MayDomine
|
3e7cc27318
|
At least tell the user that ngram verify is greedy! (#13039)
|
2025-11-12 11:29:33 +08:00 |
|
vipwangerxiao
|
8f01a12d43
|
Improve overlap scheduling for better TTFT (#11856)
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com>
|
2025-11-12 11:24:04 +08:00 |
|
hlu1
|
0d4a418424
|
[Deepseek V3.2] Fix accuracy bug in the Indexer (#12583)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-11-11 16:15:26 -08:00 |
|
b8zhong
|
cc2e36c352
|
overlap shared + routed expert computation in kimi linear (#12660)
|
2025-11-11 14:52:58 -08:00 |
|
Baizhou Zhang
|
99e25805f5
|
[Fix] Fix nan error for large scale ep (#12866)
|
2025-11-11 14:44:57 -08:00 |
|
Qiaolin Yu
|
4a2768a86b
|
Fix spec decoding acc length for dpsk-r1-fp4 tp8 (2nd attempt) (#12915)
|
2025-11-11 13:30:33 -08:00 |
|
cctry
|
e0e6a6efb2
|
Fix CPP Radix Cache and add test to CI (#11645)
|
2025-11-11 11:51:37 -08:00 |
|
Ziming Huang
|
e8114102fa
|
[Fix] Update text_chunks in bench_serving chat completions (#13041)
|
2025-11-11 11:41:11 -08:00 |
|
Frank Minors
|
7f5055ed5e
|
Fix cached tokens usage bug (#12814)
Co-authored-by: FrankMinions <liuchen@shinemo.com>
|
2025-11-12 01:02:43 +08:00 |
|
Ziming Huang
|
5de25f786e
|
[BugFix] Fix prefill memory leak in PD + GDN (#12994)
|
2025-11-12 00:48:07 +08:00 |
|
Netanel Haber
|
d52800dbf5
|
Support file:// scheme in load_video (#13076)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
|
2025-11-12 00:36:37 +08:00 |
|
yinghui
|
38a704bccb
|
refine stdout logging codes (#13015)
|
2025-11-12 00:16:14 +08:00 |
|
PiteXChen
|
527b7d3f59
|
[RadixTree] Reduce Stack Push/Pop Overhead for Leaf Nodes, Improve radix_tree Leaf Collection Performance (#12199)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
|
2025-11-11 23:35:39 +08:00 |
|
Liangsheng Yin
|
f09eee036d
|
Tiny simplify evcition metrics collector (#12983)
|
2025-11-11 23:23:48 +08:00 |
|
Ke Bao
|
e38994dd71
|
Update rope dtype config (#13037)
|
2025-11-11 22:47:29 +08:00 |
|
yctseng0211
|
4a78031a71
|
[ROCM] Optimized deepseek-r1 model with rmsnorm + fp8 quant fusion (#12689)
should be clean after https://github.com/sgl-project/sglang/pull/13017 landed
|
2025-11-11 02:59:10 -08:00 |
|
elvischenv
|
71aea45c41
|
[Fix] Add TPOT back to bench_serving (#12976)
|
2025-11-11 17:32:24 +08:00 |
|
Johnsonms
|
e3b38d7194
|
[Bug] TypeError: maybe_executor_submit() (#13050)
|
2025-11-11 00:55:13 -08:00 |
|
LHXuuu
|
5c0cadd0c6
|
Remove duplicate import (#12980)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
|
2025-11-11 16:53:39 +08:00 |
|
Yi Zhang
|
8db7fc4186
|
disable overlap schedule if mamba radix cache open (#13057)
|
2025-11-11 16:35:38 +08:00 |
|
Feng Su
|
fc8cda14cf
|
Sglang Tracing: optimize trace_event_batch() (#13036)
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
|
2025-11-11 15:02:20 +08:00 |
|
Mick
|
6a7322ffbc
|
[diffusion] doc: add support_new_models.md (#13043)
|
2025-11-11 12:49:48 +08:00 |
|
Sam
|
3594815a8b
|
Re-enable Flashinfer TRTLLM GEN MHA and Add Unit Test (#12885)
|
2025-11-10 20:17:43 -08:00 |
|
Xiaoyu Zhang
|
9caca6a45c
|
[PieceWise CUDA Graph] Support awq/gptq model in piecewise cudagraph (#12518)
|
2025-11-11 11:56:15 +08:00 |
|
Lianmin Zheng
|
40b26b456b
|
Simplify the BatchMultimodalOutput in io_struct.py (#12993)
|
2025-11-10 13:54:56 -08:00 |
|
sglang-bot
|
303cc957e6
|
chore: bump SGLang version to 0.5.5.post1 (#13000)
|
2025-11-10 11:53:43 -08:00 |
|