ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-05 22:22:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
39ba03f25d4c4c4e9f551a2dcf001cadd0b86cbe
composable_kernel/example
History
lalala-sh 39ba03f25d Moe gemm activation (#2026) 
* fix useless code and remove usless oob

* clang format

* fix coredump in e2e test

* fix2

* fix clang format

* fix output oob

* impl int64 but result not correct

* int64 index ok now

* input output all ok

* fix uint32

* revert v1 test

* use uint32

* mork to support 13w tokens

* moe sorting fix moebuf

* fix merge

* update moe api fix aiter build

* fix buid

* fuse silu

* silu ok

* acale ok

* add silu

* change code

* gemm2 ok

* gufusion compatible ok, fix warnings

* gu fusion for m32 m64 ok

* support bf16 cshuffle

* i4 gemm2 ok

* i4 gemm2 ok and i4 gemm1 build

* 16x16 run ok

* change flops; change cshuffle dtype

* fuse gelu silu act in moe gemm1

* fp8 with act ready

* int4 act ready

* remove useless changes

* remove useless code change

* fix clang format

* add the arch limit of int4 moe gemm

* fuse moe activation

* fix fp8 16x16

* fix no quant case

* fix bugs

* fix fp8 gufusion bug

* remove useless comments

* refine activation code & complete moe example

* fix int8 bugs

* merge tkw1

---------

Co-authored-by: coderfeli <coderfeli@163.com>
Co-authored-by: feli <felix.li@amd.com>
Co-authored-by: illsilin <Illia.Silin@amd.com>
Co-authored-by: root <root@hjbog-srdc-51.amd.com>
Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com>
2025-04-23 10:35:34 +08:00
..
01_gemm
CK pk_i4_t test failures fix (SWDEV-518629) (#2075)
2025-04-14 16:58:57 +08:00
02_gemm_bilinear
Fix issue with multiple targets and remove smfmac tests from unsupported test targets (#1372)
2024-07-03 23:34:38 -07:00
03_gemm_bias_relu
Split the instances by architecture. (#1223)
2024-04-02 09:42:17 -07:00
04_gemm_add_add_fastgelu
remove support for gfx940 and gfx941 targets (#1944)
2025-03-05 11:07:33 -08:00
09_convnd_fwd
Add a daily CI build on gfx908. (#1987)
2025-03-17 18:08:53 -07:00
10_convnd_fwd_multiple_d_multiple_reduce
Fix example_convnd_fwd_max_xdl_int8 failures on MI300 (#1666)
2024-11-14 08:40:50 -08:00
12_reduce
Support large: 12d tensor size for reduction kenrel (#1465)
2024-08-13 16:15:47 +02:00
13_pool2d_fwd
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
14_gemm_quantization
Split the instances by architecture. (#1223)
2024-04-02 09:42:17 -07:00
15_grouped_gemm
Post-merge changes for fully async args copy in ck grouped gemm (#1991)
2025-04-03 13:35:43 +02:00
16_gemm_multi_d_multi_reduces
Fix example_convnd_fwd_max_xdl_int8 failures on MI300 (#1666)
2024-11-14 08:40:50 -08:00
17_convnd_bwd_data
Add Grouped Conv Fwd Large Tensor kernel (#1432)
2024-08-06 10:06:10 +02:00
18_batched_gemm_reduce
remove support for gfx940 and gfx941 targets (#1944)
2025-03-05 11:07:33 -08:00
19_binary_elementwise
Refactor elementwise kernels (#1222)
2024-04-19 13:31:17 +02:00
20_grouped_conv_bwd_weight
Apply universal gemm to bwd_weight_cshuffle operator (#1873)
2025-02-18 10:10:22 +01:00
21_gemm_layernorm
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
22_cgemm
Clean DTYPES conditions in CMake (#974)
2023-10-18 11:14:14 -05:00
23_softmax
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
24_batched_gemm
CK pk_i4_t test failures fix (SWDEV-518629) (#2075)
2025-04-14 16:58:57 +08:00
25_gemm_bias_e_permute
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
26_contraction
Code clean-up (#1285)
2024-05-10 09:41:39 -07:00
27_layernorm2d_fwd
Split the static library into several files. (#1044)
2023-11-28 11:17:37 -08:00
28_grouped_gemm_bias_e_permute
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
29_batched_gemm_bias_e_permute
Merging the gfx12 code into public repo. (#1362)
2024-06-27 00:33:34 -07:00
30_grouped_conv_fwd_multiple_d
Remove CK_USE_AMD_MFMA_GFX950 (#1935)
2025-03-04 10:32:25 -08:00
31_batched_gemm_gemm
Merge from internal (#1857)
2025-02-07 15:05:05 -07:00
32_batched_gemm_scale_softmax_gemm
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
33_multiple_reduce
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
34_batchnorm
Refactor elementwise kernels (#1222)
2024-04-19 13:31:17 +02:00
35_splitK_gemm
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
36_sparse_embedding
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
37_batched_gemm_add_add_relu_gemm_add
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
38_grouped_conv_bwd_data_multiple_d
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
39_permute
Clean DTYPES conditions in CMake (#974)
2023-10-18 11:14:14 -05:00
40_conv2d_fwd_quantization
Split the instances by architecture. (#1223)
2024-04-02 09:42:17 -07:00
41_grouped_conv_conv_fwd
Merge from internal (#1857)
2025-02-07 15:05:05 -07:00
42_groupnorm_fwd
Split the static library into several files. (#1044)
2023-11-28 11:17:37 -08:00
43_splitk_gemm_bias_e_permute
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
44_elementwise_permute
Prevent instantiation of undefined FP8 operators. (#1639)
2024-11-05 13:58:29 -08:00
45_elementwise_normalization
Layernorm and groupnorm support to save mean and inverse std in forward (#929)
2023-10-19 07:36:29 +08:00
46_gemm_add_multiply
Code clean-up (#1285)
2024-05-10 09:41:39 -07:00
47_gemm_bias_softmax_gemm_permute
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
48_pool3d_fwd
Fixing most of the cppcheck errors. (#1142)
2024-01-24 13:47:48 -08:00
49_maxpool2d_bwd
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
50_put_element
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
51_avgpool3d_bwd
Fixing most of the cppcheck errors. (#1142)
2024-01-24 13:47:48 -08:00
52_im2col_col2im
Split the instances by architecture. (#1223)
2024-04-02 09:42:17 -07:00
53_layernorm2d_bwd
layernorm and groupnorm backward data (#1083)
2023-12-19 04:23:11 +08:00
54_groupnorm_bwd
layernorm and groupnorm backward data (#1083)
2023-12-19 04:23:11 +08:00
59_grouped_gemm_multi_ABD
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
60_gemm_multi_ABD
bf16A_Int8B with fastgelu/bias (#1264)
2024-04-26 07:26:30 -05:00
61_contraction_multi_ABD
add gemm_bias_add example (#1361)
2024-07-11 18:08:07 -07:00
62_convnd_activ
remove support for gfx940 and gfx941 targets (#1944)
2025-03-05 11:07:33 -08:00
63_layernorm4d_fwd
Split the static library into several files. (#1044)
2023-11-28 11:17:37 -08:00
64_fpAintB_gemm
Split the instances by architecture. (#1223)
2024-04-02 09:42:17 -07:00
65_gemm_multiply_multiply
Moe gemm activation (#2026)
2025-04-23 10:35:34 +08:00
66_complex_contraction_bilinear
update layernorm (#1570)
2024-10-22 09:26:18 +08:00
67_gemm_microscaling
MX GEMM - Add MX BF8 example (#2071)
2025-04-16 15:25:02 -06:00
ck_tile
[CK-Tile] warp-gemm support for using V_MFMA_F32_16x16x32_BF16 (#2073)
2025-04-22 15:52:36 -07:00
CMakeLists.txt
enable gfx115x support (#2065)
2025-04-09 10:06:42 -07:00
README.md
Add basic documentation structure (#1715)
2024-12-04 00:46:47 +01:00

README.md

Back to the main page

Composable Kernel examples

Reference in New Issue View Git Blame Copy Permalink