mirror of https://github.com/ROCm/composable_kernel.git synced 2026-04-19 22:39:03 +00:00

Files

MHYangAMD 3499fe67ff [CK_TILE] Enhance RMSNorm Accuracy: New Pipeline Pass for Selectable Implementation (#2409 )

* Add Rmsnorm2dFwdPipelineModelSensitiveT5Pass

* Update rmsnorm2d_fwd_pipeline_model_sensitive_pass

1.  Add BlockReduce2dTreeCrossWarpSync

* Add Rmsnorm2dFusedModelSensitiveEnum

* Update patch

1. Reverse generate.py
2. Remove comment in generate.py
3. Update tree cross warp reduce

* Refactor RMSNorm model enum and introduce T5-like option

* Update the n stage for cross warp reduce

* Add new cmdline option in RMSNorm for new pipeline testing

---------

Co-authored-by: Clement Lin <clement.lin@amd.com>
Co-authored-by: ClementLinCF <162283536+ClementLinCF@users.noreply.github.com>

2025-07-16 14:05:26 +08:00

script

[CK_TILE] Enhance RMSNorm Accuracy: New Pipeline Pass for Selectable Implementation (#2409 )

2025-07-16 14:05:26 +08:00

CMakeLists.txt

Label CMakeLists message() as DEBUG or STATUS for clean build output (#2301 )

2025-06-10 10:46:47 -07:00

example_rmsnorm2d_fwd.cpp

[CK_TILE] Enhance RMSNorm Accuracy: New Pipeline Pass for Selectable Implementation (#2409 )

2025-07-16 14:05:26 +08:00

generate.py

[CK_TILE] Enhance RMSNorm Accuracy: New Pipeline Pass for Selectable Implementation (#2409 )

2025-07-16 14:05:26 +08:00

README.md

[Ck tile] support rmsnorm and related fusion (#1605 )

2024-10-30 15:22:56 +08:00

rmsnorm2d_fwd.cpp

[CK_TILE] Enhance RMSNorm Accuracy: New Pipeline Pass for Selectable Implementation (#2409 )

2025-07-16 14:05:26 +08:00

rmsnorm2d_fwd.hpp

[CK_TILE] Enhance RMSNorm Accuracy: New Pipeline Pass for Selectable Implementation (#2409 )

2025-07-16 14:05:26 +08:00

README.md

Rmsnorm2D forward

This folder contains example for Rmsnorm2D forward using ck_tile tile-programming implementation.

build

# in the root of ck_tile
mkdir build && cd build
sh ../script/cmake-ck-dev.sh  ../ <arch>  # you can replace this <arch> to gfx90a, gfx942...
make tile_rmsnorm2d_fwd -j

This will result in an executable build/bin/tile_rmsnorm2d_fwd

cmdline

args:
          -m    m dimension (default:3328)
          -n    m dimension (default:4096)
          -e    epsilon (default:1e-5)
          -v    cpu validation or not (default:1)
       -prec    precision (default:fp16)