mirror of https://github.com/ROCm/composable_kernel.git synced 2026-04-19 22:39:03 +00:00

Files

Po Yen Chen 7d669440a6 [CK_TILE] Fix compilation errors introduced in #2320 , #2219 and #2214 (#2388 )

* Fix compilation errors

* Fix more ck_tile example compilation errors

2025-06-23 12:29:15 +08:00

instances

add fp8 as dst (#1830 )

2025-01-22 17:34:27 +08:00

misc

[CK_TILE]Moe update index (#1672 )

2024-11-25 13:12:35 +08:00

script

add fp8 as dst (#1830 )

2025-01-22 17:34:27 +08:00

CMakeLists.txt

Label CMakeLists message() as DEBUG or STATUS for clean build output (#2301 )

2025-06-10 10:46:47 -07:00

moe_smoothquant.cpp

add fp8 as dst (#1830 )

2025-01-22 17:34:27 +08:00

moe_smoothquant.hpp

[CK_TILE] Fix compilation errors introduced in #2320 , #2219 and #2214 (#2388 )

2025-06-23 12:29:15 +08:00

README.md

[CK_TILE]Moe update index (#1672 )

2024-11-25 13:12:35 +08:00

README.md

moe-smoothquant

This folder contains example for moe-smoothquant using ck_tile tile-programming implementation.

Unlike standard smoothquant op, the input scale is from different expert [expert, hidden], we need reuse the topk-id from previous topk-softmax and select the corresponding expert from current topk, and expand the output/per-token-scale by topk

build

# in the root of ck_tile
mkdir build && cd build
sh ../script/cmake-ck-dev.sh  ../ <arch>  # you can replace this <arch> to gfx90a, gfx942...
make tile_example_moe_smoothquant -j

This will result in an executable build/bin/tile_example_moe_smoothquant