Mick
|
2f9952cdbf
|
diffusion: remove unused workflows folder (#13114)
|
2025-11-12 11:51:24 +08:00 |
|
MayDomine
|
3e7cc27318
|
At least tell the user that ngram verify is greedy! (#13039)
|
2025-11-12 11:29:33 +08:00 |
|
vipwangerxiao
|
8f01a12d43
|
Improve overlap scheduling for better TTFT (#11856)
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com>
|
2025-11-12 11:24:04 +08:00 |
|
hlu1
|
0d4a418424
|
[Deepseek V3.2] Fix accuracy bug in the Indexer (#12583)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-11-11 16:15:26 -08:00 |
|
b8zhong
|
cc2e36c352
|
overlap shared + routed expert computation in kimi linear (#12660)
|
2025-11-11 14:52:58 -08:00 |
|
Baizhou Zhang
|
99e25805f5
|
[Fix] Fix nan error for large scale ep (#12866)
|
2025-11-11 14:44:57 -08:00 |
|
Qiaolin Yu
|
4a2768a86b
|
Fix spec decoding acc length for dpsk-r1-fp4 tp8 (2nd attempt) (#12915)
|
2025-11-11 13:30:33 -08:00 |
|
cctry
|
e0e6a6efb2
|
Fix CPP Radix Cache and add test to CI (#11645)
|
2025-11-11 11:51:37 -08:00 |
|
Ziming Huang
|
e8114102fa
|
[Fix] Update text_chunks in bench_serving chat completions (#13041)
|
2025-11-11 11:41:11 -08:00 |
|
Frank Minors
|
7f5055ed5e
|
Fix cached tokens usage bug (#12814)
Co-authored-by: FrankMinions <liuchen@shinemo.com>
|
2025-11-12 01:02:43 +08:00 |
|
Ziming Huang
|
5de25f786e
|
[BugFix] Fix prefill memory leak in PD + GDN (#12994)
|
2025-11-12 00:48:07 +08:00 |
|
Netanel Haber
|
d52800dbf5
|
Support file:// scheme in load_video (#13076)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
|
2025-11-12 00:36:37 +08:00 |
|
yinghui
|
38a704bccb
|
refine stdout logging codes (#13015)
|
2025-11-12 00:16:14 +08:00 |
|
PiteXChen
|
527b7d3f59
|
[RadixTree] Reduce Stack Push/Pop Overhead for Leaf Nodes, Improve radix_tree Leaf Collection Performance (#12199)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
|
2025-11-11 23:35:39 +08:00 |
|
Liangsheng Yin
|
f09eee036d
|
Tiny simplify evcition metrics collector (#12983)
|
2025-11-11 23:23:48 +08:00 |
|
Ke Bao
|
e38994dd71
|
Update rope dtype config (#13037)
|
2025-11-11 22:47:29 +08:00 |
|
yctseng0211
|
4a78031a71
|
[ROCM] Optimized deepseek-r1 model with rmsnorm + fp8 quant fusion (#12689)
should be clean after https://github.com/sgl-project/sglang/pull/13017 landed
|
2025-11-11 02:59:10 -08:00 |
|
elvischenv
|
71aea45c41
|
[Fix] Add TPOT back to bench_serving (#12976)
|
2025-11-11 17:32:24 +08:00 |
|
Johnsonms
|
e3b38d7194
|
[Bug] TypeError: maybe_executor_submit() (#13050)
|
2025-11-11 00:55:13 -08:00 |
|
LHXuuu
|
5c0cadd0c6
|
Remove duplicate import (#12980)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
|
2025-11-11 16:53:39 +08:00 |
|
Yi Zhang
|
8db7fc4186
|
disable overlap schedule if mamba radix cache open (#13057)
|
2025-11-11 16:35:38 +08:00 |
|
Feng Su
|
fc8cda14cf
|
Sglang Tracing: optimize trace_event_batch() (#13036)
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
|
2025-11-11 15:02:20 +08:00 |
|
Mick
|
6a7322ffbc
|
[diffusion] doc: add support_new_models.md (#13043)
|
2025-11-11 12:49:48 +08:00 |
|
Sam
|
3594815a8b
|
Re-enable Flashinfer TRTLLM GEN MHA and Add Unit Test (#12885)
|
2025-11-10 20:17:43 -08:00 |
|
Xiaoyu Zhang
|
9caca6a45c
|
[PieceWise CUDA Graph] Support awq/gptq model in piecewise cudagraph (#12518)
|
2025-11-11 11:56:15 +08:00 |
|
Lianmin Zheng
|
40b26b456b
|
Simplify the BatchMultimodalOutput in io_struct.py (#12993)
|
2025-11-10 13:54:56 -08:00 |
|
sglang-bot
|
303cc957e6
|
chore: bump SGLang version to 0.5.5.post1 (#13000)
|
2025-11-10 11:53:43 -08:00 |
|
sogalin
|
661c1c97ad
|
Add pre-suffle weight for new aiter MoE support. (#12908)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
|
2025-11-10 11:42:55 -08:00 |
|
Liangsheng Yin
|
1086473111
|
Enhance retract test (page cases, long output cases) (#12781)
|
2025-11-11 03:03:26 +08:00 |
|
Liangsheng Yin
|
665416f6dd
|
Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224)
|
2025-11-11 02:56:22 +08:00 |
|
Liangsheng Yin
|
f1f4c451ab
|
Add process_prefill_chunk back to fix PP event loop (#13009)
|
2025-11-11 00:51:36 +08:00 |
|
fzyzcjy
|
b0ee99dd03
|
Super tiny fix typo (#13001)
|
2025-11-11 00:47:45 +08:00 |
|
Ke Bao
|
58b12ccb46
|
Support piecewise cuda graph for deepseek v3 (#12996)
|
2025-11-10 23:18:03 +08:00 |
|
sglang-bot
|
37c40a87a8
|
chore: bump sgl-kernel version to 0.3.17 (#12966)
|
2025-11-10 21:50:58 +08:00 |
|
Yuhao Yang
|
1240ac13b8
|
vlm: fix tiny multimodal cache bug (#12984)
|
2025-11-10 21:30:19 +08:00 |
|
Mick
|
5639145fac
|
diffusion: reduce effort of supporting new model (#12982)
|
2025-11-10 21:20:33 +08:00 |
|
ShawnKung
|
afee2843d5
|
feat(metrics): add scheduler and hiradix cache metrics (#10218) (#10225)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-11-10 18:14:47 +08:00 |
|
Zhihao Zhang
|
6f08488042
|
fix missing output_token_logprobs when using ngram speculative decoding (#10702)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
|
2025-11-10 02:04:42 -08:00 |
|
Lianmin Zheng
|
9ea2c686c7
|
[Auto Sync] Update batch_invariant_ops.py (20251109) (#12916)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-10 01:51:39 -08:00 |
|
PiteXChen
|
e2a784ecda
|
[RadixTree] Reduce Syscalls, Optimize Collection Filtering and Align with cpp (#12239)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
|
2025-11-10 17:47:59 +08:00 |
|
Neelabh Sinha
|
7bffc5dc25
|
[Fix] Add validation for served model name to reserve : for LoRA adapter syntax (#12912)
Co-authored-by: neelabhsinha <neelabhsinha97@gmail.com>
|
2025-11-09 23:42:02 -08:00 |
|
Xuchun Shang
|
ac19ce7efb
|
[PP] put pp assert in model runner (#12934)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-11-10 14:58:19 +08:00 |
|
Mick
|
95876d75cb
|
chore: include a minimum image for vlms when warming-up (#9528)
|
2025-11-10 14:56:59 +08:00 |
|
Liangsheng Yin
|
dc8a5a1ce7
|
[Refactor / Style] Unify all event loops (except for PP) (#12959)
|
2025-11-10 14:49:12 +08:00 |
|
Mick
|
e123648b36
|
diffusion: fix wan-2.2-TI2V and support sp (#12926)
|
2025-11-10 14:37:57 +08:00 |
|
kk
|
90401cf7d2
|
Fix the run-time error when calling fused_rms_mxfp4_quant that change return output number (#12803)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2025-11-09 21:48:36 -08:00 |
|
Atream
|
9cfe78dd30
|
clean redundant code in previous PR (#12957)
|
2025-11-09 21:40:32 -08:00 |
|
Atream
|
ddd1440d0f
|
Refactor KTransformers heterogeneous compute with unified GPU-quantization backend (#12834)
Co-authored-by: Chen Hongtao <56470055+chenht2022@users.noreply.github.com>
Co-authored-by: chenht2022 <cht22@mails.tsinghua.edu.cn>
Co-authored-by: skqliao <skqliao@gmail.com>
Co-authored-by: ovowei <1913953267@qq.com>
|
2025-11-09 21:06:32 -08:00 |
|
Edwin Gao
|
d1be60c3c5
|
[Refactor] rename set_index_k_and_scale_buffer to set_index_k_scale_b… (#12956)
|
2025-11-09 20:35:19 -08:00 |
|
MMuzzammil1
|
1f2a6c691b
|
Bugfix: LMCache Connector with Sglang (#12946)
Signed-off-by: Mohd Muzzammil <me.muzzammil@samsung.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-11-10 12:13:37 +08:00 |
|