pansicheng
|
d879e37f1b
|
Add interface_v1 option for dynamic HiCache backend (#13140)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-11-17 17:42:17 -08:00 |
|
Kaixi Hou
|
e389f91dec
|
[NVIDIA] Fix broken fp8 MoE of deepseek v3 (#13264)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-11-17 16:13:28 -08:00 |
|
Vedant V Jhaveri
|
aac07bf7fd
|
[Embeddings Performance Testing] Add performance test for embedding models (#12359)
|
2025-11-17 15:35:18 -08:00 |
|
Simo Lin
|
25acbbc612
|
Remove verbs from GET endpoint paths to follow REST standards (#13273)
|
2025-11-17 12:34:36 -08:00 |
|
hlu1
|
a8fcbf6fe3
|
[Deepseek V3.2] Use torch.compile to speed up torch.cat in nsa (#13022)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-11-17 12:20:49 -08:00 |
|
Liangsheng Yin
|
6042010964
|
[2/N] CI refactor: sperate some backend-independent CPU tasks. (#13447)
|
2025-11-18 02:08:19 +08:00 |
|
Mick
|
ff00b6adbe
|
diffusion: fix loading with local model_path (#13445)
|
2025-11-18 00:56:30 +08:00 |
|
Rain H
|
c236d05f8c
|
Fix log time stats (#13418)
|
2025-11-17 23:10:49 +08:00 |
|
Carlo Mussolini
|
df56139226
|
Adding user defined hooks support (#13217)
|
2025-11-17 23:07:37 +08:00 |
|
kebyn
|
15db5497d3
|
[feature] Custom base path on FastAPI server (#5879)
Co-authored-by: lianhu.yin <lianhu.yin@nio.com>
Co-authored-by: kebyn <kebyn@kebyn.cc>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-11-17 22:40:09 +08:00 |
|
Mike Qiu
|
9ba3597d2a
|
Fix cache_tokens calculate issue when retracted (#11900)
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com>
|
2025-11-17 21:25:38 +08:00 |
|
Xuchun Shang
|
80797c2a15
|
[PD][bug fix] fix memleak when last_batch is none (#13144)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-11-17 21:22:20 +08:00 |
|
Mick
|
7afff8fd1a
|
diffusion: fix wan2.2 ti2v num_frames adjust logic (#13379)
Co-authored-by: adarshxs <adarsh.shirawalmath@gmail.com>
Co-authored-by: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com>
|
2025-11-17 20:53:15 +08:00 |
|
AlphaBaby
|
ac406d4301
|
fix uneven PP layer indices (#13282)
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
|
2025-11-17 19:54:23 +08:00 |
|
Yi Zhang
|
a3e4fe4b41
|
refactor linear memory pool (#13004)
|
2025-11-17 16:24:29 +08:00 |
|
fzyzcjy
|
f3e9336dcb
|
Support weight update for blackwell DeepGEMM (#13324)
|
2025-11-17 15:55:26 +08:00 |
|
Teng Ma
|
290fcd8971
|
[HiCache] add GPU id to IB dev topo for mooncake storage backend (#13112)
|
2025-11-17 15:48:29 +08:00 |
|
huangtingwei
|
1dcde53928
|
[HiCache] support memory_pool_host page head layout (#11644)
|
2025-11-17 13:45:17 +08:00 |
|
Liangsheng Yin
|
ab63f3c50b
|
[1/N] CI refactor: introduce CI register. (#13345)
|
2025-11-17 12:21:20 +08:00 |
|
Zilin Zhu
|
147b782352
|
[RL] re-abort_request when model_update_lock is still locked (#13338)
|
2025-11-17 12:13:39 +08:00 |
|
lixiaolx
|
d368c7451a
|
(1/n)support context parallel with deepseekv3.2-DSA (#12065)
|
2025-11-16 20:12:25 -08:00 |
|
sglang-bot
|
7b2fb3d47c
|
chore: bump SGLang version to 0.5.5.post3 (#13366)
|
2025-11-16 17:55:38 -08:00 |
|
Lifu Huang
|
254f62d879
|
Support spec decoding when LoRA is applied to target model (#12903)
|
2025-11-16 13:20:23 -08:00 |
|
DangKai
|
e970892ffa
|
fix import qwenvl error in RL engine (#12874)
|
2025-11-16 12:01:16 -08:00 |
|
b8zhong
|
d5fa58c4dd
|
fix nightly docker build (#13386)
|
2025-11-16 11:21:09 -08:00 |
|
Liangsheng Yin
|
e019f233f9
|
Remove unused code / testcases in lang (#13335)
|
2025-11-16 22:48:35 +08:00 |
|
Xinyuan Tong
|
b1c688fba2
|
refactor: cleanup vision attention related codes (#13228)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: alisonshao <54658187+alisonshao@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-11-16 22:44:40 +08:00 |
|
Zilin Zhu
|
8e3663d4e8
|
Add default enable_memory_saver to HybridLinearKVPool (#13371)
|
2025-11-16 22:35:13 +08:00 |
|
Zilin Zhu
|
9edb0e0da3
|
Add SGLANG_ENABLE_REQ_POOL_LEAK_STRICT_CHECK to bypass mem leak check (#13339)
|
2025-11-16 22:02:22 +08:00 |
|
Xiaoyu Zhang
|
95f43669b5
|
[2 / 2] apply sgl-kernel weak_ref_tensor (#12978)
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
|
2025-11-16 21:24:35 +08:00 |
|
Xiaoyu Zhang
|
50691d7b49
|
[opt kimi k2 2/n] apply kimi k2 thinking moe_fused_gate (#13332)
|
2025-11-16 21:20:08 +08:00 |
|
Yuhao Yang
|
6afe396399
|
diffusion: support fa4 in fa backend for blackwell (#13263)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-16 21:02:45 +08:00 |
|
Adarsh Shirawalmath
|
d724670873
|
[diffusion] refactor and added tests for Flux, T2V, TI2V, I2V(#13344)
|
2025-11-16 19:58:04 +08:00 |
|
Zilin Zhu
|
9509c4ccd3
|
[RL] enable offloading hybrid linear attn model (#13336)
|
2025-11-16 17:12:52 +08:00 |
|
Qiaolin Yu
|
78a4b446c6
|
Fix dpsk-r1-fp4 tp8 by reverting two commits (#13162 and #13341) (#13348)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-11-15 21:31:36 -08:00 |
|
DarkSharpness
|
f969664172
|
[Performance] Move the contiguous to torch compile region (#13199)
|
2025-11-15 20:49:52 -08:00 |
|
b8zhong
|
f35f7f1245
|
[Piecewise CUDA Graph] Support W4A8 (#13179)
|
2025-11-16 11:53:50 +08:00 |
|
ash-sigh
|
12c789ebd1
|
[Ascend]support xgrammar backend for ascend npu (#12310)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-11-15 19:39:24 -08:00 |
|
kyleliang-nv
|
597d416070
|
[feature] Add layerwise NVTX support (#11870)
|
2025-11-15 19:20:56 -08:00 |
|
sglang-bot
|
1ca205f6da
|
chore: bump sgl-kernel version to 0.3.17.post1 (#13358)
|
2025-11-15 19:11:41 -08:00 |
|
b8zhong
|
24a25ffa20
|
[Piecewise CUDA Graph] Support ModelOpt FP4 (#13101)
|
2025-11-16 11:03:19 +08:00 |
|
Lianmin Zheng
|
db7299aa30
|
[Fix] Register custom ops only if they exist (#13321)
|
2025-11-15 17:48:17 -08:00 |
|
Vincent Zhong
|
0d116b9a0b
|
Clean up deprecated tile_tokens_dim for next flashinfer (#13341)
Signed-off-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
|
2025-11-16 00:50:15 +08:00 |
|
FlyPanda
|
51f9b9628b
|
[optimize] Provide Usrbio compilation and installation commands (#12329)
|
2025-11-15 23:06:24 +08:00 |
|
xlzheng
|
37e8724ef3
|
perf: optimize TypeBasedDispatcher using dict for O(1) lookup (#12001)
|
2025-11-15 22:02:42 +08:00 |
|
Zhihao Lyu
|
10592e9c08
|
[Ascend][Feat] Add Ascend sampling backend (#12692)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-11-15 21:59:58 +08:00 |
|
Even Zhou
|
2aec8b6e1b
|
[Feature] Spec-Overlap supporting DP-ATTN; PD-Disaggregation; npugraph mode (#12443)
|
2025-11-15 21:51:07 +08:00 |
|
Adarsh Shirawalmath
|
3f400f25df
|
[Diffusion] add health endpoints to diffusion server (#13329)
|
2025-11-15 19:12:37 +08:00 |
|
Yongfei Xu
|
d91b16eb16
|
Opt tp: tp attn support tp reduce scattered input (#10568)
|
2025-11-15 02:08:12 -08:00 |
|
Charles Chen
|
b051d76dab
|
Fix: add missing get_embed_and_head in MiniMax M2 for Eagle3 (#13297)
|
2025-11-15 01:36:03 -08:00 |
|