Commit Graph

3 Commits

Author SHA1 Message Date
rocking5566
fe367bc917 Refine layernorm naming and test code (#497)
* Sync the naming

* Sync the test of layernorm with groupnorm

* Sync the naming

* Minor change for comment and log

* [What] Add saveMean and SaveInvVariance in the interface.
[Why] These can optimize the backward

[ROCm/composable_kernel commit: d4d1147f0a]
2022-11-02 16:57:28 -06:00
rocking5566
454c5faed6 Only need one test case here (#483)
[ROCm/composable_kernel commit: 87fd11526f]
2022-10-27 19:08:53 -06:00
rocking5566
c6e8de46da Fix bug of layernorm ckProfiler and refine code (#448)
* Fix bug of profiler for layernorm

* 1. Rename layernorm into normalization
2. Decouple softmax from normalization

* clang-format

[ROCm/composable_kernel commit: 1b62bfaa2a]
2022-10-12 21:06:39 -05:00