kvcache-ai/sglang
1
0
Fork 0
mirror of https://github.com/kvcache-ai/sglang.git synced 2026-07-08 00:07:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
9,885 Commits 157 Branches 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

251 Commits

Author SHA1 Message Date
blake-snc
5fc328465a fix(sgl-kernel): support CUDA 13 runtime preloading for DGX Spark (#18747) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-16 00:43:04 +08:00
SoluMilken
07a24f1a38 update pre-commit config (#18860) 2026-02-16 00:18:31 +08:00
Xiaoyu Zhang
c29394e3c8 [kernel slimming] Move fast_hadamard_transform to jit_kernel (#18475) 2026-02-14 23:06:21 +08:00
jianan-gu
336dc4579e [CPU] Optimize Qwen3-next model on CPU (#12525) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: Fan Yin <1106310035@qq.com>
 2026-01-29 22:03:58 -08:00
Xiaoyu Zhang
fb74e43707 [Diffusion] Delete sgl-kernel outdated time_embedding kernel (#17278) 2026-01-28 14:18:53 +08:00
Michael
53609e5e5b Revert "[Diffusion] Move diffusion time embedding to jit kernel" (#17257) 2026-01-17 21:29:22 +08:00
Xiaoyu Zhang
2cdd4370bc [Diffusion] Move diffusion time embedding to jit kernel (#16879) 2026-01-17 12:21:22 +08:00
sglang-bot
c86ca12875 chore: bump sgl-kernel version to 0.3.21 (#16888) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-01-14 13:27:49 +08:00
Johnny
b5493f65be [NVIDIA] upstream FA4 (#15182) 
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-01-11 15:31:28 +08:00
sglang-bot
a39126672a chore: bump sgl-kernel version to 0.3.20 (#15564) 2025-12-21 13:15:23 -08:00
66RING
46be74b4b4 [diffusion] kernel: timestep embedding kernel implementation (#12995) 
Co-authored-by: 戚余航 <qiyuhang@bytedance.com>
Co-authored-by: Qi Yuhang <45795032+HydraQYH@users.noreply.github.com>
 2025-12-19 20:59:50 +08:00
sunxxuns
f2d64e6782 [amd] Add deterministic all-reduce kernel for AMD (ROCm) (#15340) 
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
 2025-12-18 23:36:03 -08:00
Kevin_Xiong
4792d1f452 [sgl-kernel][1/2] Fused qk_norm_rope for GLM4.6 (#15141) 2025-12-18 17:07:04 +08:00
sglang-bot
4a62a0e3cd chore: bump sgl-kernel version to 0.3.19 (#14632) 2025-12-08 19:02:24 +08:00
Yuhao Yang
f72a77038f modify the sgl-kernel to be compatible with transformers 5.x. (#14625) 2025-12-08 00:39:00 -08:00
sglang-bot
e11f795f63 chore: bump sgl-kernel version to 0.3.18.post3 (#14427) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-12-05 14:09:02 -08:00
Qiaolin Yu
cb8df87fc1 [1/2] Add rope kernel in sgl-kernel (#14334) 2025-12-04 16:45:44 +08:00
Qi Yuhang
16ff892c18 [sgl-kernel][Feat][B200][1/N] Support MXFP8 Grouped GEMM in Blackwell (#13731) 
Co-authored-by: Yineng Zhang <me@zhyncs.com>
 2025-12-04 10:09:09 +08:00
Antonin Vidon
df1f31241b [sgl-kernel] fix runtime error while preloading CUDA runtime (#13089) 2025-12-02 23:03:51 +08:00
sglang-bot
34035d8cd9 chore: bump sgl-kernel version to 0.3.18.post2 (#14229) 2025-12-02 00:50:40 +08:00
Xiaoyu Zhang
3de09aadbc Add new moe wna16 marlin gemm (#14122) 2025-12-01 23:07:53 +08:00
Yuan Luo
e12c78aab6 [sgl-kernel][1/2] Fused qk_norm_rope for Qwen3-MoE (#14036) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-11-28 12:25:15 +08:00
sglang-bot
391a863b3f chore: bump sgl-kernel version to 0.3.18.post1 (#13942) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-11-25 15:31:53 -08:00
Xiaoyu Zhang
ecefc7904f [sgl-kernel Code Clean] Remove useless lightning_attention kernel (#13819) 2025-11-24 18:26:25 +08:00
sglang-bot
a22104a676 chore: bump sgl-kernel version to 0.3.18 (#13816) 2025-11-23 17:24:54 -08:00
Xiaoyu Zhang
fb04d43428 [kimi k2 thinking] Avoid useless torch.zeros_ (#13596) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-11-21 13:15:27 +08:00
Roger Young
e72cf13693 Support moe topk sigmoid kernel (#13049) 
Co-authored-by: xuebi <xuebi@minimaxi.com>
 2025-11-20 00:24:37 +08:00
sglang-bot
b638abbae6 chore: bump sgl-kernel version to 0.3.17.post2 (#13542) 2025-11-18 22:08:23 -08:00
sglang-bot
4a56fa5cf2 chore: bump sgl-kernel version to 0.3.17.post1 (#13325) 2025-11-15 23:36:32 +08:00
Xiaoyu Zhang
1d3d42bda0 [opt kimi k2 1 / n] Add kimi k2 moe fused gate (#13287) 2025-11-15 17:14:19 +08:00
Ke Bao
8e9f05ece1 Update marlin moe kernel interface (#13322) 2025-11-15 17:10:39 +08:00
Ke Bao
2a96e302cb Revert moe sum reduce for marlin moe (#13314) 2025-11-15 15:57:41 +08:00
Fan Yin
2966367a31 [sgl-kernel] support custom fp8 flashmla kernel (#13087) 2025-11-13 12:45:21 -08:00
Xiaoyu Zhang
547de8c774 [1 / 2] register weak_ref_tensor in sgl-kernel (#12999) 2025-11-10 22:12:59 +08:00
sglang-bot
a30f190762 chore: bump sgl-kernel version to 0.3.17 (#12931) 2025-11-10 14:54:02 +08:00
sglang-bot
b2b26d4324 chore: bump sgl-kernel version to 0.3.16.post6 (#12889) 2025-11-09 09:16:28 +08:00
Ke Bao
44f594d832 Apply moe_reduce_sum kernel for fused_marlin_moe (#12888) 2025-11-09 01:31:05 +08:00
hlu1
b8ddc296f4 [sgl-kernel][Deepseek V3.2] Add row_starts to topk kernel (#12582) 
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
 2025-11-07 18:33:27 -08:00
fzyzcjy
193fbb0bce Super tiny add UT for copy_to_gpu_no_ce (#12270) 2025-11-04 09:40:51 +08:00
Lianmin Zheng
20315697f4 move all get_stream in sgl_kernel to c++ to reduce the launch overhead (#12521) 2025-11-02 13:15:05 -08:00
sglang-bot
a920b9dace chore: bump sgl-kernel version to 0.3.16.post5 (#12511) 2025-11-02 14:08:11 +08:00
yinghui
a80bcb5a68 Add env var to disable FA4 warmup (#12430) 2025-10-31 12:25:00 -07:00
Lianmin Zheng
2d5605e89b Fix ci install to allow prerelease (#12449) 2025-10-31 02:22:15 -07:00
Lianmin Zheng
c0652d907b Clean up sgl kernel (#12413) 
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
 2025-10-31 01:13:34 -07:00
zejunchen-zejun
8a6838212a [Fix] fix type issue of env flag value MODELOPT_MAX_TOKENS_PER_EXPERT (#11709) 
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>
 2025-10-29 09:44:05 -07:00
huangtingwei
3e6281d0aa [HiCache]Page head layout IO kernel (#11615) 2025-10-26 15:53:50 +08:00
Kai-Hsun Chen
6371f7af27 [quantization] AWQ Marlin doesn't work when dtype is bfloat16 (#11494) 
Signed-off-by: Kai-Hsun Chen <khchen@x.ai>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2025-10-26 15:49:45 +08:00
DarkSharpness
e8b71445c0 [Misc] Improve the error message of failed import (#12119) 2025-10-25 12:09:05 -07:00
sglang-bot
a04212f128 chore: bump sgl-kernel version to 0.3.16.post4 (#12103) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-10-24 22:04:14 -07:00
Fan Yin
23afdfd1c2 [sgl-kernel] support flashmla libtorch (#11717) 2025-10-21 21:17:50 -07:00