3 Commits

Author	SHA1	Message	Date
rocking5566	c6e8de46da	Fix bug of layernorm ckProfiler and refine code (#448) ... * Fix bug of profiler for layernorm * 1. Rename layernorm into normalization 2. Decouple softmax from normalization * clang-format [ROCm/composable_kernel commit: 1b62bfaa2a]	2022-10-12 21:06:39 -05:00
rocking5566	9a5ffb01eb	Group norm (#417) ... * Add groupnorm example by layernorm 1. Reference is not ready 2. shape of gamma and beta need to be fix * Let shape of gamma and beta can be same as x * Modify test, instance and client example * [What] Fix bug of layernorm for greater than 2 dimension. [Why] We need to get upper length from merge transform instead of embed transform. * Add reference for groupnorm * Fuse sigmoid after groupnorm * [What] Rename original layernorm into layernorm2d [Why] Prepare to add groupnorm using layernorm5d * clang-format * Add groupnorm test * Refine error message * Add groupnorm ckProfiler * Test groupnorm kernel from device_instance * update example * upadte profiler * Fix test naming * Fix argc number * Move descriptor and sweeponce to argument for quick debugging Co-authored-by: Chao Liu <chao.liu2@amd.com> [ROCm/composable_kernel commit: 4eba345f6e]	2022-09-19 22:30:46 -05:00
rocking5566	01a7af65bb	ckProfiler for layernorm (#330) ... * Refine parameter * Add base class for layernorm * Add layernorm instance * Add layernorm to ckProfiler * Remove redundant * Add verification * Fix compile error due to merge [ROCm/composable_kernel commit: fdfd7eb597]	2022-08-11 17:03:54 -05:00