mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-14 02:02:46 +00:00

Files

ruanjm 9f9eddd0cf [CK_TILE] Add Various Fusion Functions to RMSNorm (#1802 )

* Add shortcut to RMSNorm

* Modify test for adding shortcut for RMSNorm

* Add fused parameter into tests

* 1. Add YDataType. 2. rmsnorm2d_fwd_traits_ from rmsnorm2d_fwd.hpp to rmsnorm2d_fwd_api.cpp and rmsnorm2d_fwd_instance_common.hpp

* 1. Supports various stride and percisions.

* Add support of Epilogue

* Add fuse and epilogue support to rmsnorm ref

* Modify rmsnorm example

* Refactor tests/examples

* Bug fix for newly added tests/examples

* Bug fix for new tests 2

* Modify smoke test scripts

remove dbg code

* Supports non-smooth dyanmic quant

* Update Rmsnorm2dFwd::GetName()

* rename xscale and prec_sx to smoothscale and prec_sm

Bug fix after rename

Remove files

* change example_rmsnorm2d_fwd.cpp

* update performance calculator

* Fix issue in two-pass when fuse add is enabled

* Remove comment of beta

---------

Co-authored-by: rocking <ChunYu.Lai@amd.com>

[ROCm/composable_kernel commit: 04dd314883]

2025-01-15 10:23:48 +08:00

instances

[CK_TILE] Add Various Fusion Functions to RMSNorm (#1802 )

2025-01-15 10:23:48 +08:00

script

[Ck_tile] smoothquant (#1617 )

2024-11-01 13:51:56 +08:00

CMakeLists.txt

support max3 in smoothquant and add+ rmsnorm + rdquant (#1654 )

2024-11-27 05:01:15 +08:00

example_smoothquant.cpp

[CK_TILE] Add Various Fusion Functions to RMSNorm (#1802 )

2025-01-15 10:23:48 +08:00

README.md

[Ck_tile] smoothquant (#1617 )

2024-11-01 13:51:56 +08:00

smoothquant.cpp

[CK_TILE] Add Various Fusion Functions to RMSNorm (#1802 )

2025-01-15 10:23:48 +08:00

smoothquant.hpp

[CK_TILE] Add Various Fusion Functions to RMSNorm (#1802 )

2025-01-15 10:23:48 +08:00

README.md

smoothquant

This folder contains example for smoothquant using ck_tile tile-programming implementation.

build

# in the root of ck_tile
mkdir build && cd build
sh ../script/cmake-ck-dev.sh  ../ <arch>  # you can replace this <arch> to gfx90a, gfx942...
make tile_smoothquant -j

This will result in an executable build/bin/tile_smoothquant

cmdline

args:
          -m    m dimension (default:3328)
          -n    m dimension (default:4096)
          -v    cpu validation or not (default:1)
       -prec    precision (default:fp16)