mirror of
https://github.com/ROCm/composable_kernel.git
synced 2026-05-05 14:11:29 +00:00
* Add groupnorm example by layernorm 1. Reference is not ready 2. shape of gamma and beta need to be fix * Let shape of gamma and beta can be same as x * Modify test, instance and client example * [What] Fix bug of layernorm for greater than 2 dimension. [Why] We need to get upper length from merge transform instead of embed transform. * Add reference for groupnorm * Fuse sigmoid after groupnorm * [What] Rename original layernorm into layernorm2d [Why] Prepare to add groupnorm using layernorm5d * clang-format * Add groupnorm test * Refine error message * Add groupnorm ckProfiler * Test groupnorm kernel from device_instance * update example * upadte profiler * Fix test naming * Fix argc number * Move descriptor and sweeponce to argument for quick debugging Co-authored-by: Chao Liu <chao.liu2@amd.com>
18 lines
826 B
CMake
18 lines
826 B
CMake
add_custom_target(test_layernorm)
|
|
|
|
add_gtest_executable(test_layernorm2d_fp32 test_layernorm2d_fp32.cpp)
|
|
add_gtest_executable(test_layernorm2d_fp16 test_layernorm2d_fp16.cpp)
|
|
add_gtest_executable(test_groupnorm_fp16 test_groupnorm_fp16.cpp)
|
|
add_gtest_executable(test_groupnorm_fp32 test_groupnorm_fp32.cpp)
|
|
|
|
target_link_libraries(test_layernorm2d_fp32 PRIVATE utility)
|
|
target_link_libraries(test_layernorm2d_fp16 PRIVATE utility)
|
|
target_link_libraries(test_groupnorm_fp16 PRIVATE utility device_normalization_instance)
|
|
target_link_libraries(test_groupnorm_fp32 PRIVATE utility device_normalization_instance)
|
|
|
|
add_dependencies(test_layernorm test_layernorm2d_fp32)
|
|
add_dependencies(test_layernorm test_layernorm2d_fp16)
|
|
add_dependencies(test_layernorm test_groupnorm_fp16)
|
|
add_dependencies(test_layernorm test_groupnorm_fp32)
|
|
|