rocking
|
1db7560365
|
Backward of gamma and beta for layernorm and groupnorm (#1013)
* Add layernorm backward reference code
* Add groupnorm backward reference code
* Add example
* clang format
* Fixc bug of reference layernorm and groupnorm
* Fix naming
* Refine naming
* Add device op for normalization bwd gamma and beta
* Refine template parameter
* Add bwd gamma & beta of kernel
* 1. Add groupnorm example
2. Refine layernorm naming
* Narrow down the static check for performance
* Refine variable name
|
2023-11-10 18:02:03 +08:00 |
|