mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-03 05:01:25 +00:00

Files

chenjun 4e73177684 Ck tile/smoothquant out stride (#1742 )

* add ck_tile/smoothquant out stride parameter

* Remove the default stride value

---------

Co-authored-by: so <a.com>

2024-12-13 11:53:52 +08:00

instances

[Ck_tile] smoothquant (#1617 )

2024-11-01 13:51:56 +08:00

script

[Ck_tile] smoothquant (#1617 )

2024-11-01 13:51:56 +08:00

CMakeLists.txt

support max3 in smoothquant and add+ rmsnorm + rdquant (#1654 )

2024-11-27 05:01:15 +08:00

example_smoothquant.cpp

Ck tile/smoothquant out stride (#1742 )

2024-12-13 11:53:52 +08:00

README.md

[Ck_tile] smoothquant (#1617 )

2024-11-01 13:51:56 +08:00

smoothquant.cpp

Ck tile/smoothquant out stride (#1742 )

2024-12-13 11:53:52 +08:00

smoothquant.hpp

[Ck_tile] smoothquant (#1617 )

2024-11-01 13:51:56 +08:00

README.md

smoothquant

This folder contains example for smoothquant using ck_tile tile-programming implementation.

build

# in the root of ck_tile
mkdir build && cd build
sh ../script/cmake-ck-dev.sh  ../ <arch>  # you can replace this <arch> to gfx90a, gfx942...
make tile_smoothquant -j

This will result in an executable build/bin/tile_smoothquant

cmdline

args:
          -m    m dimension (default:3328)
          -n    m dimension (default:4096)
          -v    cpu validation or not (default:1)
       -prec    precision (default:fp16)