mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-14 10:09:41 +00:00

Files

Illia Silin 24f228df3b upgrade from clang-format-12 to clang-format-18 (#2568 )

* upgrade to clang-format-18

* update to clang-format-18 in pre-commit-config

[ROCm/composable_kernel commit: 504b101da3]

2025-07-28 11:34:07 -07:00

instances

add fp8 as dst (#1830 )

2025-01-22 17:34:27 +08:00

misc

[CK_TILE]Moe update index (#1672 )

2024-11-25 13:12:35 +08:00

script

add fp8 as dst (#1830 )

2025-01-22 17:34:27 +08:00

CMakeLists.txt

Label CMakeLists message() as DEBUG or STATUS for clean build output (#2301 )

2025-06-10 10:46:47 -07:00

moe_smoothquant.cpp

upgrade from clang-format-12 to clang-format-18 (#2568 )

2025-07-28 11:34:07 -07:00

moe_smoothquant.hpp

[CK_TILE] Fix compilation errors introduced in #2320 , #2219 and #2214 (#2388 )

2025-06-23 12:29:15 +08:00

README.md

[CK_TILE]Moe update index (#1672 )

2024-11-25 13:12:35 +08:00

README.md

moe-smoothquant

This folder contains example for moe-smoothquant using ck_tile tile-programming implementation.

Unlike standard smoothquant op, the input scale is from different expert [expert, hidden], we need reuse the topk-id from previous topk-softmax and select the corresponding expert from current topk, and expand the output/per-token-scale by topk

build

# in the root of ck_tile
mkdir build && cd build
sh ../script/cmake-ck-dev.sh  ../ <arch>  # you can replace this <arch> to gfx90a, gfx942...
make tile_example_moe_smoothquant -j

This will result in an executable build/bin/tile_example_moe_smoothquant