kvcache-ai/sglang
1
0
Fork 0
mirror of https://github.com/kvcache-ai/sglang.git synced 2026-06-30 11:48:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
11,824 Commits 157 Branches 0 Tags
cfd49e233ceb94de3f702f70aef06e299836aede
Commit Graph

40 Commits

Author SHA1 Message Date
Baizhou Zhang
6ecd6f84db [CI] Add per-job uv venv isolation and upgrade CI version to Cuda 13 (#23119) 
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-04-19 05:32:36 -07:00
Alex Nails
43eb66028f ci: install rust toolchain in ci_install_dependency.sh (#23017) 2026-04-16 23:18:22 -07:00
Baizhou Zhang
8fe9bbffb6 [CI] Reinstall flashinfer-jit-cache on CUDA version mismatch (#22741) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-13 23:04:23 -07:00
Baizhou Zhang
b441317aa4 Revert "Upgrade CI default CUDA version from 12.9 to 13.0" (#22727) 2026-04-13 14:39:24 -07:00
Alison Shao
3f4fbc165d Upgrade CI default CUDA version from 12.9 to 13.0 (#21441) 2026-04-12 21:48:40 -07:00
Mohammad Miadh Angkad
701a0e0c25 [CI/Docker] Clean up redundant flashinfer cubin downloads (#22491) 2026-04-12 12:30:41 -07:00
Alison Shao
f21d23a211 ci: use local NVIDIA wheels to avoid re-downloading ~2GB every CI run (#22602) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-11 21:32:51 -07:00
Rain Jiang
1a8eb890f6 Kernels community fa3 (#20796) 2026-04-07 12:48:44 -07:00
Feng Su
8732b2e9c6 [CI] [Tracing] Add ci for tracing and fix bugs (#21740) 2026-04-02 10:50:50 -07:00
Shangming Cai
7004df6094 chore: bump mooncake version to 0.3.10.post1 (#21844) 2026-04-02 10:54:22 +08:00
Noa Neria
8d9145d97e Direct model loading from object storage with Runai Model Streamer (#17948) 
Signed-off-by: Noa Neria <noa@run.ai>
 2026-04-01 18:41:22 -07:00
Liangsheng Yin
53d8aa23ae Cache nvidia wheels locally to skip repeated 830 MB downloads in CI (#21778) 2026-03-31 16:06:09 -07:00
Baizhou Zhang
d52757fe97 [CI]Remove msgm-en and mmlu tests which cause timeout (#21733) 2026-03-31 01:10:05 -07:00
Alison Shao
3650bfb199 Remove flashinfer wheel cache cleanup that deletes other versions (#21711) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-03-30 16:47:04 -07:00
Shangming Cai
1487f80158 chore: bump mooncake version to 0.3.10 (#20942) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-03-27 10:35:31 +08:00
Alison Shao
5297a3cb46 [CI] Rewrite killall_sglang as Python with CI/local dual mode (#21331) 
Co-authored-by: Alison Shao <alison.shao@mac.lan>
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-03-24 23:54:01 -07:00
Alison Shao
44db0c59cf [CI] Fix cutlass import error: restore nvidia-cutlass-dsl force-reinstall (#21182) 
Co-authored-by: Alison Shao <alison.shao@mac.lan>
 2026-03-22 22:41:01 -07:00
Lianmin Zheng
50404e0d1f ci: refactor CUDA dependency install script (#21017) 2026-03-20 21:36:58 -07:00
Ke Bao
05c00088e3 Cleanup broken dist-info directories in ci deps install (#20817) 2026-03-18 17:09:23 +08:00
Rain Jiang
cb1e63aba4 bump fa4 to official released fa4 pkg (#20303) 2026-03-17 17:22:56 -07:00
Baizhou Zhang
826eb21bca Fix sglang-kernel dependency on CI runners (#20715) 2026-03-16 15:23:01 -07:00
Xiaoyu Zhang
15097c5c3b Release sglang kernel 0.4.0 (#20440) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-16 20:34:58 +08:00
sglang-bot
93afe15b43 chore: bump flashinfer version to 0.6.6 (#20480) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-03-14 13:05:10 -07:00
Rain Jiang
ab4b863546 fix ci by removing nvidia-cutlass-dsl-libs-base and force reinstall n… (#20380) 2026-03-11 13:37:33 -07:00
Xiaoyu Zhang
680d9d98e4 Fix cutedsl ci error (#20309) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-11 16:17:35 +08:00
Xinyuan Tong
4a757990a1 [VLM] Replace decord with torchcodec for video decoding (#20055) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: BakerBunker <17872844+BakerBunker@users.noreply.github.com>
 2026-03-09 19:23:49 +08:00
Alison Shao
1c1712d8e5 [CI] Skip flashinfer-cubin reinstall when version matches (#19470) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-05 13:30:44 -08:00
Mohammad Miadh Angkad
6822941514 [FlashInfer] Bump FlashInfer version from 0.6.3 to 0.6.4 (#19005) 2026-03-02 16:12:09 -08:00
Alison Shao
750ecf4a45 Add server CUDA graph warmup CI step for cold H200 nodes (#19201) 2026-02-24 16:07:01 -08:00
Alison Shao
f9c3def7fe Fix CI: add flashinfer --download-cubin to install dependencies (#18887) 
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2026-02-16 13:50:10 -08:00
Mohammad Miadh Angkad
1be41e9036 [FlashInfer] Bump FlashInfer version from 0.6.2 to 0.6.3 (#18448) 2026-02-14 07:43:33 +08:00
Kangyan-Zhou
1b8f68af57 Fix B200 installation issue (#18725) 2026-02-12 22:06:23 +08:00
Alison Shao
f20b1703ce [CI] Fix torchaudio/torchvision CUDA version mismatch (#18211) 2026-02-11 23:47:32 -08:00
Alison Shao
7eaf866846 [CI] Install python3-dev for Triton JIT compilation on fresh runners (#18644) 2026-02-11 16:28:57 -08:00
Alison Shao
dcc63dc545 [CI] Guard python3 call in install script for fresh runners (#18609) 2026-02-12 00:05:29 +08:00
Shangming Cai
52401bec1d chore: bump mooncake version to 0.3.9 (#18316) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-02-07 17:30:01 +08:00
Kangyan-Zhou
e5ac6229e1 Fix installation script for H200 runners (#18050) 2026-01-31 23:30:51 -08:00
shaharmor98
f6f1b6d000 Bump FI version (#17700) 
Signed-off-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
 2026-01-26 16:50:06 +08:00
Alison Shao
7b22b8ff8a Fix sgl-kernel install: fail instead of PyPI fallback when artifacts missing (#17728) 2026-01-26 11:46:49 +08:00
Makcum888e
d1042e0d62 [Refactore] [CI] Remove redundant CI test runs step 2 (#17584) 2026-01-24 23:39:48 -08:00