kvcache-ai/sglang
1
0
Fork 0
mirror of https://github.com/kvcache-ai/sglang.git synced 2026-07-09 00:37:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
9,885 Commits 157 Branches 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

6437 Commits

Author SHA1 Message Date
Alison Shao
b6523a4f72 fix: restrict cache validation behaviors to CI only (#14849) 2025-12-10 16:03:53 -08:00
b8zhong
c51efb8b84 fix fp8 gemm nightly CI (#14844) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-10 15:57:51 -08:00
Binyao Jiang
a4992873d4 Treat unittest SkipTest exception as pass instead of as failure (#14847) 2025-12-10 15:28:21 -08:00
b8zhong
da9b801eb7 fix lora target all + csgmv backend (#14796) 2025-12-10 11:42:51 -08:00
Siyuan Chen
0e54a69548 [bugfix] qwen25-VL support lora (#14638) 2025-12-10 11:38:51 -08:00
Yuhao Yang
c1bd5ee8c5 Revert transformers to 4.57.1 (#14801) 2025-12-10 11:04:36 -08:00
Mick
d659873762 [diffusion] CI: use unified sampling_params for CI (#14045) 2025-12-11 01:18:56 +08:00
Mick
6c5ebc0ef7 [diffusion] parallel: pad tokens for video models under sp (#14833) 2025-12-11 01:15:37 +08:00
Ke Bao
5b5571a8da Apply back moe_sum_reduce for fused_marlin_moe (#14829) 2025-12-11 00:39:41 +08:00
Li Jinliang
83e35a7c29 [diffusion] doc: fix tiny typo in multimodal_gen/README.md (#14830) 2025-12-11 00:27:25 +08:00
liupeng374
b8cfa02c01 [NPU] bug fix for mtp and w4a8 (#14806) 2025-12-10 22:55:13 +08:00
fzyzcjy
5eccaf7737 Support HTTP response status code prometheus metrics (#14710) 2025-12-10 22:28:57 +08:00
Xiaoyu Zhang
12b7a4fab0 [diffusion] performance: refactor diffusion fuse qkv and apply to qwen-image (#14793) 2025-12-10 18:55:41 +08:00
Yuhao Yang
02f1e81e2d Revert "fix: checking if tokenizer is in cache before downloading from HF" (#14808) 2025-12-10 01:14:35 -08:00
Prozac614
908c7186af [diffusion] CI: Add LoRA support to diffusion server configuration and test cases (#14697) 2025-12-10 16:51:47 +08:00
Yuan Luo
03836d85d2 [GLM-4.6V] Support Pipeline Parallelism for GLM-4.6V & GLM-4.1V (#14720) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-10 16:40:12 +08:00
Mick
87dbdddc93 [diffusion] profile: early exit when enough steps are captured to reduce the size of the trace file (#14803) 2025-12-10 16:11:22 +08:00
yrk111222
6c9c8da64d fix: add missing logic for SGLANG_USE_MODELSCOPE variable (#14794) 2025-12-10 15:49:34 +08:00
Peng Zhang
21028b5507 [RL] support weight reload for low-bit rollout (#9650) 
Co-authored-by: Hecate0821 <hec4te0821@gmail.com>
Co-authored-by: eternally-z <zzywzj@gmail.com>
Co-authored-by: Wilboludriver <wilbolu@outlook.com>
Co-authored-by: Wilbolu <81792854+Wilboludriver@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
 2025-12-10 15:44:01 +08:00
Yuhao Yang
793c98afaf handling incomplete rope_scaling config ci after transformers upgrade (#14784) 2025-12-09 22:56:16 -08:00
TomerBN-Nvidia
b1cbfce612 fix server args bug (#14725) 2025-12-09 21:05:05 -08:00
Alison Shao
01835998e1 fix: race condition between validation and download locks (#14761) 2025-12-09 20:36:54 -08:00
Lianmin Zheng
4285e99da7 [Auto Sync] Update data_parallel_controller.py, detokenizer... (20251209) (#14759) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-12-09 18:38:38 -08:00
ShawnY112358
f077436831 [fix] Fix issues for in-flight weight updates (#14064) 
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
 2025-12-09 18:12:19 -08:00
Liangsheng Yin
cbc7dcdaa7 Re-add the API serving timing metrics. (#14744) 
Signed-off-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
Co-authored-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
 2025-12-10 10:17:48 +09:00
Ethan (Yusheng) Su
0c63fb9420 [Feature] Add LoRA support for embedding layers (#14177) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Beichen-Ma <bm685@cornell.edu>
 2025-12-09 15:53:33 -08:00
Lianmin Zheng
18bd8e8d6d Improve CI by trying a warmup before unit tests (#14669) 2025-12-09 15:17:59 -08:00
Lianmin Zheng
036e64dafa move multi-item scoring functions in tokenizer manager into a separate file (#14740) 2025-12-09 14:47:06 -08:00
Douglas Yang
8b0b6a45c8 fix: checking if tokenizer is in cache before downloading from HF (#14698) 2025-12-09 13:08:07 -08:00
b8zhong
55504df2f7 Add FP8 Blockwise GEMM Backend Flag --fp8-gemm-backend (#14379) 2025-12-09 12:05:56 -08:00
Yuhao Yang
15bc8cbd74 fix rope parameter initialization error caused by transformers v5.0 update (#14745) 2025-12-09 10:51:26 -08:00
yudian0504
9496f12d00 [Model] Add PaddleOCR-VL Model Support (#12953) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-09 10:16:02 -08:00
Lianmin Zheng
ab0048793c Revert "[Feat] Add received_time in serving_base" (#14743) 2025-12-09 06:52:27 -08:00
blahblah
6ec77680df [diffusion] feat: support comparing batch perf (#14738) 
Co-authored-by: shuxiguo <shuxiguo@meituan.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-09 22:48:52 +08:00
yrk111222
98c430e114 fix: prevent HugginqFace access when SGLANG_USE_MODELSCOPE is enabled (#12039) 2025-12-09 21:02:05 +08:00
zhanghaotong
fe7f91ef82 [Feat] Add received_time in serving_base (#13432) 
Signed-off-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
 2025-12-09 22:00:24 +09:00
kun-llfl
cef5ba65b1 [Bugfix] Fix environ error in scheduler_runtime_checker_mixin.py (#14461) 
Signed-off-by: Kun(llfl) <i@imux.top>
 2025-12-09 20:33:41 +08:00
Xiaoyu Zhang
53d170883a Add fuse_marlin_moe test to ci and add new ep test (#14686) 2025-12-09 20:17:38 +08:00
Rain Jiang
f0e948a0f1 fix the deepep 8 gpu unit test (#14601) 2025-12-09 01:40:09 -08:00
Yineng Zhang
b626334475 fix: make override DeepseekV2Model work (#14707) 2025-12-08 23:11:18 -08:00
fzyzcjy
da3dc497b0 Fix dp-aware incompatible with completions and chat completions APIs (#14647) 2025-12-09 13:24:53 +08:00
Lianmin Zheng
ce4e836be5 Add per-request decode tp size (#14678) 
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
 2025-12-08 20:24:31 -08:00
Yineng Zhang
0e0b0c0566 Revert "[Bug] fix not desired disable fused share experts caused by r… (#14676) 2025-12-08 20:06:52 -08:00
Alison Shao
08da4c2618 [Bugfix] Fix KeyError for Mistral-Large-3 rope_scaling config (#14627) 2025-12-08 19:16:00 -08:00
kk
c106b54b57 Aiter fp8 kv cache (#13147) 2025-12-08 16:39:53 -08:00
fzyzcjy
119fd956fb Tiny support printing requests in bench_serving for observability (#14652) 2025-12-09 08:27:58 +08:00
PiteXChen
eac5b66485 [RadixTree] Optimize the Time Complexity of Node Retrieval Operation from O(n*m) to O(n) (#13334) 
Signed-off-by: CLFutureX <chenyongqyl@163.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
 2025-12-08 15:55:09 -08:00
Francis
07404d7689 [HiCache] fix condition check when use decode offload (#14489) 2025-12-08 15:52:40 -08:00
Binyao Jiang
6abb8051e8 Bump up diffusers to latest official release version (#14670) 2025-12-08 13:41:01 -08:00
b8zhong
32f8b6064e improve default glm mtp setting (#14457) 
Signed-off-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-08 13:27:13 -08:00