ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-11 17:00:18 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
c004e0d99048d76c40da81c4dd2a36921cee0293
composable_kernel/example/53_layernorm_bwd
History
rocking 1db7560365 Backward of gamma and beta for layernorm and groupnorm (#1013) 
* Add layernorm backward reference code

* Add groupnorm backward reference code

* Add example

* clang format

* Fixc bug of reference layernorm and groupnorm

* Fix naming

* Refine naming

* Add device op for normalization bwd gamma and beta

* Refine template parameter

* Add bwd gamma & beta of kernel

* 1. Add groupnorm example
2. Refine layernorm naming

* Narrow down the static check for performance

* Refine variable name
2023-11-10 18:02:03 +08:00
..
CMakeLists.txt
Backward of gamma and beta for layernorm and groupnorm (#1013)
2023-11-10 18:02:03 +08:00
layernorm2d_bwd_fp16.cpp
Backward of gamma and beta for layernorm and groupnorm (#1013)
2023-11-10 18:02:03 +08:00