mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-15 10:37:44 +00:00

Files

rocking 0658353bab [Ck_tile] smoothquant (#1617 )

* fix compile error

* fix typo of padding

* Add smoothquant op

* Add smoothquant instance library

* refine type

* add test script

* Re-generate smoothquant.hpp

* Always use 'current year' in copyright

* use Generic2dBlockShape instead

* Add vector = 8 instance back

* Find exe path automatically

* Simplify the api condition

* Remove debugging code

* update year

* Add blank line between function declaration

* explicitly cast return value to dim3

* refine return value

* Fix default warmup and repeat value

* Add comment

* refactor sommthquant cmake

* Add README

* Fix typo

---------

Co-authored-by: Po Yen, Chen <PoYen.Chen@amd.com>

[ROCm/composable_kernel commit: fbd654545a]

2024-11-01 13:51:56 +08:00

instances

[Ck_tile] smoothquant (#1617 )

2024-11-01 13:51:56 +08:00

script

[Ck_tile] smoothquant (#1617 )

2024-11-01 13:51:56 +08:00

add_rmsnorm2d_rdquant_fwd.cpp

[Ck tile] support rmsnorm and related fusion (#1605 )

2024-10-30 15:22:56 +08:00

add_rmsnorm2d_rdquant_fwd.hpp

[Ck_tile] smoothquant (#1617 )

2024-11-01 13:51:56 +08:00

CMakeLists.txt

[Ck tile] support rmsnorm and related fusion (#1605 )

2024-10-30 15:22:56 +08:00

example_add_rmsnorm2d_rdquant_fwd.cpp

[Ck_tile] smoothquant (#1617 )

2024-11-01 13:51:56 +08:00

README.md

[Ck tile] support rmsnorm and related fusion (#1605 )

2024-10-30 15:22:56 +08:00

README.md

Add + Rmsnorm2D + rowwise dynamic quantization forward

This folder contains example for add + Rmsnorm2D + rowwise dynamic quantization forward using ck_tile tile-programming implementation. Rdquant is short for rowwise dynamic quantization here.

build

# in the root of ck_tile
mkdir build && cd build
sh ../script/cmake-ck-dev.sh  ../ <arch>  # you can replace this <arch> to gfx90a, gfx942...
make tile_add_rmsnorm2d_rdquant_fwd -j

This will result in an executable build/bin/tile_add_rmsnorm2d_rdquant_fwd

cmdline

args:
          -m    m dimension (default:3328)
          -n    m dimension (default:4096)
          -e    epsilon (default:1e-5)
          -v    cpu validation or not (default:1)
       -prec    precision (default:fp16)