Commit Graph

59 Commits

Author SHA1 Message Date
jhchouuu
1412e287bf [AMD][MoRI] bump MoRI to v1.1.0 (#22870) 2026-04-16 00:11:55 -07:00
Vladimir (Vova) Vagaytsev
5ef67cee16 [AMD] Fix aiter import failure in ROCm Docker images (#22363) 2026-04-15 18:40:05 -07:00
Thomas Wang
4a746ea462 [AMD] Remove aiter hotfixes in Dockerfile covered by aiter v0.1.12.post1 (#22657) 2026-04-13 00:01:37 -07:00
Bingxu Chen
213027951a [AMD] Upgrade Aiter (#22264) 2026-04-10 18:40:43 -07:00
Duyi-Wang
ac593fed90 [AMD][Dockerfile] Support build-arg AITER_COMMIT for rocm.Dockerfile (#21949) 2026-04-03 01:54:28 -07:00
Thomas Wang
7431db7392 [AMD] Enable FP8 KV cache and FP8 attention kernel for NSA on MI300/MI355 with TileLang backend (#21511) 2026-04-03 00:58:23 -07:00
jhchouuu
4b8456e266 [AMD][MoRI] bump MoRI to v0.1.0 (#21673) 2026-03-30 14:44:11 -07:00
Bingxu Chen
2e7682414b [AMD] Fix Aiter Prebuild When Releasing ROCm720 Image (#20195) 2026-03-09 21:02:38 -07:00
kk
f016738f4c fix syntax error: "&&" unexpected (#20093) 2026-03-07 02:06:21 -08:00
kk
bd108a5971 Add workaround for aiter triton gemm config issue (#20090)
Co-authored-by: HAI <hixiao@gmail.com>
2026-03-07 01:21:31 -08:00
Thomas Wang
550506894a [AMD] Upgrade aiter version (#19936)
Co-authored-by: HaiShaw <hixiao@gmail.com>
2026-03-06 02:31:04 -08:00
Hubert Lu
05f68e1230 [AMD] Fix the hipDeviceGetName issue in ROCm based docker images (#19440)
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
2026-03-03 11:42:48 -08:00
Duyi-Wang
8240a87306 [AMD] MORI-EP support for EP4. (#19578) 2026-02-28 13:13:46 -08:00
Alan Kao
9b2fbf7e6a [AMD] Merge Dockerfiles for ROCm (#19203)
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
2026-02-27 00:53:51 -08:00
Michael
f230967e65 [AMD] Fix ROCm Docker builds, update apache-tvm-ffi (#19359) 2026-02-26 10:16:28 +08:00
Hubert Lu
8bd644765f [AMD] Enable ROCm kvcache JIT path and add AMD CI coverage. (#18992)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-25 14:15:05 +08:00
Simo Lin
edba96b98a fix(docker): migrate ROCm Dockerfiles from setuptools-rust to maturin (#19210)
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
2026-02-23 19:00:05 -08:00
HAI
6a999dbdf8 [AMD] ENV flags tuning and cleanup (#19176) 2026-02-22 22:40:00 -08:00
Duyi-Wang
5ddc84e33e [AMD] MORI-EP inter kernel type switch (#18437)
Co-authored-by: HAI <hixiao@gmail.com>
2026-02-15 20:59:39 -08:00
Thomas Wang
e20e6c28b9 [AMD] Fix accuracy issue when running TP4 dsv3 model with mtp (#18607)
Co-authored-by: YC Tseng <yctseng@amd.com>
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
2026-02-12 01:13:16 -08:00
YC Tseng
d94d0af573 [AMD] Turn on aiter-prebuild (#18425)
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
2026-02-10 00:49:35 -08:00
YC Tseng
28717e3d28 [AMD] CI - Fix AMD daily image release and install dependency (#18452)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-02-08 22:20:09 -08:00
Bingxu Chen
3f3c201243 [AMD] Update aiter to v0.1.10.post2 (#18423)
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
2026-02-08 22:08:24 -08:00
YC Tseng
ea04bc1dd6 [AMD] Fix aiter version in rocm image (#18076) 2026-02-01 19:00:38 -08:00
kk
ec76c390c9 Add ROCm + Mori docker build instructions in rocm.Dockerfile (#18018)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-01-30 19:12:07 -08:00
YC Tseng
b7b1ba329e [AMD] fix pip sglang version (#17950) 2026-01-29 17:19:57 -08:00
RoyWang
30adf78f82 [diffusion]: align sglang diffusion AMD pyproject_other.toml diffusion dependency with pyproject.toml (#16225)
Co-authored-by: roywang <roywang@amd.com>
2026-01-29 01:50:57 -08:00
Niko Ma
cbf90d70ff [PD] Support KV transfer with MORI-IO (#14626)
Co-authored-by: cwortman-amd <cwortman@amd.com>
2026-01-28 23:22:41 -08:00
Hubert Lu
93423ff780 [AMD] Deprecate ROCm 6.3 artifacts and standardize gfx942 on ROCm 7 (#17785) 2026-01-27 15:58:49 -08:00
Hubert Lu
df42f4d386 [AMD] Update dsv3.2 AMD GPU docs and unify ROCm TileLang build (#17783)
Co-authored-by: wufann <715544327@qq.com>
2026-01-26 21:10:32 -08:00
wufann
a921029b97 [AMD] Support ds3.2 on gfx942 platform (#17504)
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
2026-01-22 13:57:08 -08:00
R0CKSTAR
a1dd3d48ac [diffusion] hardware: support diffusion (single GPU, 3/N) (#17105)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-01-16 17:01:09 +08:00
Hubert Lu
8716589826 [AMD][Diffusion] support timestep embedding kernel for AMD GPUs (#16766) 2026-01-12 22:17:07 -08:00
Thomas Wang
820e97d6c9 Upgrade aiter version (#16619) 2026-01-06 22:20:42 -08:00
Yuzhen Zhou
4bf06635fc [diffusion] multi-platform: support diffusion on amd and fix encoder loading on MI325 (#13760)
Co-authored-by: Sabre Shao <sabre.shao@amd.com>
Co-authored-by: Yusheng (Ethan) Su <yushengsu.thu@gmail.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
Co-authored-by: xsun <sunxiao04@gmail.com>
2025-12-19 15:38:46 +08:00
sglang-bot
5c8bd8b51b chore: bump SGLang version to 0.5.6.post2 (#14858)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-12-11 12:29:52 -08:00
yctseng0211
763888b5a8 [AMD] change fused rms quant interface for aiter upgrade (#14497) 2025-12-08 09:09:23 -08:00
sglang-bot
9a327bdfcf chore: bump SGLang version to 0.5.6.post1 (#14651) 2025-12-09 00:35:28 +08:00
Simo Lin
aed835e32d [model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512) 2025-12-05 12:41:48 -08:00
sglang-bot
7ae368efde chore: bump SGLang version to 0.5.6 (#14316)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-12-02 17:17:13 -08:00
Thomas Wang
5a8adca900 Turn off PREBUILD aiter in MI355 (#13963) 2025-11-25 22:30:39 -08:00
Thomas Wang
7dcf910d53 Add support for new aiter version (AR accuracy, is_shuffled PR) (#13554)
Co-authored-by: sogalin <39478626+sogalin@users.noreply.github.com>
2025-11-19 22:17:57 -08:00
Sai Enduri
fe3bbfb40c [AMD CI] Update sgl-router python path in dockerfile. (#13458) 2025-11-17 18:13:24 -08:00
sglang-bot
7b2fb3d47c chore: bump SGLang version to 0.5.5.post3 (#13366) 2025-11-16 17:55:38 -08:00
Hubert Lu
2ce2377740 [AMD] Fix AITER_MXFP4_MOE_SF setting for gfx950 (#13239) 2025-11-13 17:03:41 -08:00
sglang-bot
ebaf86d441 chore: bump SGLang version to 0.5.5.post2 (#13129)
Include the critical fix https://github.com/sgl-project/sglang/pull/12915.
2025-11-12 20:35:20 +08:00
sogalin
d26ec39ff2 Update aiter to v0.1.7.post1 (#13149) 2025-11-12 03:09:44 -08:00
Hubert Lu
36d147121f [AMD] Apply AITER_MXFP4_MOE_SF=1 only to gfx950 in aiter build (#13092) 2025-11-11 12:26:09 -08:00
sglang-bot
303cc957e6 chore: bump SGLang version to 0.5.5.post1 (#13000) 2025-11-10 11:53:43 -08:00
sogalin
661c1c97ad Add pre-suffle weight for new aiter MoE support. (#12908)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
2025-11-10 11:42:55 -08:00