Files
composable_kernel/example/ck_tile/02_layernorm2d
rocking 9656814197 1. Add save mean and save std back
2. Move construction of tensor_view and tile_window to operator()
2024-10-14 12:18:41 +00:00
..
2024-10-12 17:32:09 +08:00
2024-10-12 17:32:09 +08:00
2024-10-12 17:32:09 +08:00
2024-10-12 17:32:09 +08:00
2024-10-12 17:32:09 +08:00
2024-10-12 17:32:09 +08:00

Layernorm2D forward

This folder contains example for Layernorm2D forward using ck_tile tile-programming implementation.

build

# in the root of ck_tile
mkdir build && cd build
sh ../script/cmake-ck-dev.sh  ../ <arch>  # you can replace this <arch> to gfx90a, gfx942...
make tile_example_layernorm2d_fwd -j

This will result in an executable build/bin/tile_example_layernorm2d_fwd

example

args:
          -m    m dimension (default:3328)
          -n    m dimension (default:4096)
          -e    epsilon (default:1e-5)
          -v    cpu validation or not (default:1)
       -prec    precision (default:fp16)