mirror of https://github.com/ROCm/composable_kernel.git synced 2026-04-19 22:39:03 +00:00

Files

rocking 0023f01ab0 [Ck tile] Support layernorm one pass (#1512 )

* Fix compile error

* Add one pass pipeline

* Extract creating tile_window to operator()

* clang format

* reduce duplicated code

* do not hardcode

* Support padding in layernorm

---------

Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>

2024-10-07 14:25:53 +08:00

CMakeLists.txt

layernorm2d forward (#1339 )

2024-06-24 08:45:52 +08:00

layernorm2d_fwd.cpp

[Ck tile] Support layernorm one pass (#1512 )

2024-10-07 14:25:53 +08:00

layernorm2d_fwd.hpp

layernorm2d forward (#1339 )

2024-06-24 08:45:52 +08:00

README.md

layernorm2d forward (#1339 )

2024-06-24 08:45:52 +08:00

README.md

Layernorm2D forward

This folder contains example for Layernorm2D forward using ck_tile tile-programming implementation.

build

# in the root of ck_tile
mkdir build && cd build
sh ../script/cmake-ck-dev.sh  ../ <arch>  # you can replace this <arch> to gfx90a, gfx942...
make tile_example_layernorm2d_fwd -j

This will result in an executable build/bin/tile_example_layernorm2d_fwd

example

args:
          -m    m dimension (default:3328)
          -n    m dimension (default:4096)
          -e    epsilon (default:1e-5)
          -v    cpu validation or not (default:1)
       -prec    precision (default:fp16)