kvcache-ai/sglang
1
0
Fork 0
mirror of https://github.com/kvcache-ai/sglang.git synced 2026-07-06 07:17:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
9,135 Commits 157 Branches 0 Tags
7ace64d1d88de1dfd3cfb6622f3fcbba4fe7eef8
Commit Graph

5892 Commits

Author SHA1 Message Date
Ke Bao
7ace64d1d8 Update mamba env setting (#17566) 2026-01-23 11:02:32 +08:00
siyu
62e6a749b0 Skip mm feature pool init to avoid EPD OOM (#16388) 2026-01-23 10:53:45 +08:00
MMuzzammil1
2399af5557 Bugfix: Writing to storage when write-back method is chosen (#14718) 2026-01-22 15:08:25 -08:00
hxie
13f88045b3 configuration file support and nixl integration augmentation for hicache-storage-backend-extra-config (#16602) 2026-01-22 14:31:48 -08:00
wufann
a921029b97 [AMD] Support ds3.2 on gfx942 platform (#17504) 
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
 2026-01-22 13:57:08 -08:00
Jacob Gordon
15b511771d refactor(codespell): corrects typos covered up by whitelist (#17601) 2026-01-22 11:45:47 -08:00
Jacob Gordon
2c86a065db types: preps SessionReqNode for IDE-driven renames (#17602) 2026-01-22 11:36:23 -08:00
Baizhou Zhang
283a2daeaa [hotfix] Reenable all reduce fusion on sm100 (#17591) 2026-01-22 23:36:38 +08:00
Yuhao Yang
f7a0bcda1e model: step3-vl-10b (#17513) 2026-01-22 23:15:08 +08:00
Jincong Chen
72f790bf6f [BUGFIX] Skip Mamba Cache Slot 0 to Avoid Using Dummy Cache (#17404) 2026-01-22 23:08:38 +08:00
Xiaoyu Zhang
5324027007 [Diffusion] Make the apply_qknorm function easier to use (#17537) 2026-01-22 22:32:15 +08:00
triple-mu
3705f90629 [diffusion] model: optimize torch.compile (#17472) 2026-01-22 22:05:47 +08:00
chenxu214
5d299c25c0 [NPU] bugfix with Kimi-k2 and bge-reranker-v2 model (#17478) 
Co-authored-by: amote-i <49533125+amote-i@users.noreply.github.com>
Co-authored-by: cy <chenyang08056032@163.com>
 2026-01-22 22:02:05 +08:00
chenxu214
a4dc432587 Change naming for graph mode on multiplatform (#17469) 2026-01-22 19:25:06 +08:00
Minglei Zhu
419bbcee10 refactor Qwen3-Next with a new RadixLinearAttention (#17373) 2026-01-22 17:42:06 +08:00
zhangheng
f33022d039 [RadixTree][3/N Refactor]：Support unified insert/evict params (#17401) 2026-01-22 17:36:31 +08:00
Chandrakant Khandelwal
61abff66c1 [NPU] [Bug Fix] Fix typo in npu device check in gpt_oss.py (#17553) 2026-01-21 23:26:35 -08:00
Zaili Wang
6a8f68b6d2 [Fix] fix device orientation for image processor (#15859) 2026-01-22 15:03:10 +08:00
Zaili Wang
672eb37534 [CPU][Fix CI] Solidate torch version for sgl-kernel-cpu and fix device orientation error (#17460) 2026-01-22 14:04:50 +08:00
Baizhou Zhang
e2d33531f3 [Kernel] Little refactor of flashinfer allreduce norm fusion (#17474) 2026-01-22 13:31:57 +08:00
Chi McIsaac
71482dd171 [diffusion] feat: enable passing Cache‑DiT config for diffusers backend (#16662) 
Signed-off-by: Chi <chixie.mcisaac@gmail.com>
Signed-off-by: qimcis <chixie.mcisaac@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-22 13:13:34 +08:00
YC Tseng
17807caf82 [AMD] fix amd ci dpskv32 (#17432) 
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
 2026-01-21 20:34:24 -08:00
Baizhou Zhang
fafa171529 [hotfix] Fixes on cuda 13 docker image (#17541) 
Co-authored-by: iforgetmyname <iforgetmyname@users.noreply.github>
 2026-01-22 12:29:55 +08:00
Yingchun Lai
a5bbcda968 fix: prefer to use max_completion_tokens rather than max_tokens (#17516) 2026-01-21 20:22:20 -08:00
Baizhou Zhang
3373545b9f [HotFix]Fix dtype mismatch in nsa indexer on AMD device (#17518) 2026-01-22 12:17:02 +08:00
Piotr Mazurek
d6e2b88288 Add Liquid Foundation Model (LFM2) (#16890) 2026-01-22 11:11:20 +08:00
cen121212
0c2993eed0 Optimize Qwen3-VL video memory usage (#16366) 2026-01-22 09:10:08 +08:00
Xiaoyu Zhang
590969ee9c [Diffusion] Support select fa2 backend in hopper (#17514) 2026-01-22 08:23:53 +08:00
Lianmin Zheng
b74a57a8d9 [Auto Sync] Update detokenizer_manager.py, io_struct.py, mu... (20260120) (#17442) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Wangfan Fu <wangfan@x.ai>
 2026-01-21 14:48:32 -08:00
DarkSharpness
95f59c13fd [Chore] include all jit files in building packages (#17493) 2026-01-21 14:48:02 -08:00
Lingjun Wen
cf89351691 [new-model] Add support for Cohere2ForCausalLM behind Command-A and Command-R Models (#16927) 2026-01-21 12:28:33 -08:00
Lianmin Zheng
1fdf5cac39 [Auto Sync] Update environ.py, fp8.py (20260121) (#17486) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
 2026-01-21 12:04:09 -08:00
Jacob Gordon
cda43ffa4d ci: avoids duplication of codespell config (#17519) 2026-01-21 12:02:37 -08:00
Yunmeng
390898545e [Misc] Fix argument help string formatting (#17416) 2026-01-21 09:25:32 -08:00
Ke Bao
d725487dc8 Disable swa memory for gpt-oss with spec (#17517) 2026-01-22 01:04:19 +08:00
JiaruiChang5268
a95c9f5b81 [NPU] Remove paged attention & Change fia to default attention (#17394) 
Co-authored-by: Liwansi <62291011+Liwansi@users.noreply.github.com>
Co-authored-by: chenxu214 <justin_cc2025@163.com>
Co-authored-by: chenyang08056032 <chenyang08056032@163.com>
 2026-01-21 23:58:25 +08:00
Xiaoyu Zhang
19089aa431 [Diffusion] Refactor diffusion is_cuda check (#17498) 2026-01-21 23:02:24 +08:00
Qiaolin Yu
4f6f5d25c8 Support fa4 decoding (#16034) 2026-01-21 22:54:02 +08:00
b8zhong
2ff0880a0e [Fix] GLM 4.7 + NVFP4 + MTP (#17166) 2026-01-21 21:34:18 +08:00
Zhu Yuhua
2c1b164a92 [diffusion] improve: skip negative prompt encoding when guidance_scale <= 1.0 or negative_prompt is None (#16919) 
Signed-off-by: zhuyuhua-v <yuhzhu@amd.com>
 2026-01-21 20:01:55 +08:00
strgrb
bcc6d84f93 Use fused_sigmoid_gating_delta_rule_update_kernel for KDA (#17108) 2026-01-21 19:24:29 +08:00
Ke Bao
a618202fc7 Tiny refine swa kv cache free (#17417) 2026-01-21 19:20:05 +08:00
siyu
7520b92927 Support EPD error handling (#16670) 
Co-authored-by: ZhengWG <zwg0606@gmail.com>
 2026-01-21 18:47:00 +08:00
Fan Lin
e7224e9681 [diffusion] fix: fix the LoRA weights mismatch caused by weights packing (#17355) 2026-01-21 18:17:16 +08:00
HuangJi
e776239afd [diffusion] feat: support SageSparseLinearAttention attention backend (#17399) 2026-01-21 18:13:51 +08:00
Yi Zhang
1b97fa769b [BUGFIX] fix value oom in radix tree (#17400) 2026-01-21 17:12:57 +08:00
Yi Zhang
236772c0e1 [RadixTree][2/N Refactor]: swa cache init tiny refactor (#17397) 2026-01-21 15:48:30 +08:00
Sam Shleifer
0d49b13fdd Fix circular import in quantization modules (#17372) 2026-01-21 15:47:09 +08:00
blahblah
0a7a2017a0 [diffusion] refactor: refactor and simplify teacache for cachabledit and wanvideo (#16396) 
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: blahblah <blahblah>
 2026-01-21 15:42:45 +08:00
Baizhou Zhang
8251a74d5f [Tiny] Backward compatibility for fp4 gemm flags (#17466) 2026-01-21 14:34:40 +08:00