ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-04 21:51:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
29206047868b5a3eda88aa33ff5b997ba4e008b4
composable_kernel/example
History
Po Yen Chen 2920604786 [CK_TILE] Add logits soft-capping & customization support to the FMHA forward kernel/pipelines (#2163) 
* hack for cap logits

* fix bug

* Re-format files

* Allow specifying logits_soft_cap through APIs

* Support turn on/off logits_soft_cap in async pipeline

* Do not generate non-verified kernels

* Align receipt used in Aiter

* Sync logits soft-capping across pipelines

* Re-enable some hdim pipelines

* fix perf

* Add attention variant for logits_soft_cap

* Add newline at end-of-file

* Fix performance

* Add comment to explain logits_soft_cap pre-processing

* Unify code

* Unify floating-point literal style

* Use class data member to slience the compilation error

* [CK_TILE] Update attention customizaton interface: add LogitsMask() (#2133)

* Send 'mask' along with variant params to the LogitsMask()

* Send block indices to the variant

* Add indices parameters in variant interface

* Fix fmha bwd codegen error

* Allow switch logits_soft_cap impl

* Eliminate register spills

* Fix compilation errors

* Fix wrong LSE

* Fix LSE for splitkv kernel

* Sync splitkv pipeline changes

* Add batch_prefill kernel/pipeline

* Fix codegen error

* Undo changes in CMakeLists.txt

* Merge pipeline filtering check

* Use different code path if kHasLogitsSoftCap=false

* Remove [[maybe_unused]] attribute

* Use pre-existing compile-time flag to instantiate templates

* Sync pipeline changes

* Update CHANGELOG.md

---------

Co-authored-by: Bernard <bernaliu@amd.com>
Co-authored-by: coderfeli <coderfeli@163.com>
2025-05-13 12:19:25 +08:00
..
01_gemm
CK pk_i4_t test failures fix (SWDEV-518629) (#2075)
2025-04-14 16:58:57 +08:00
02_gemm_bilinear
Fix issue with multiple targets and remove smfmac tests from unsupported test targets (#1372)
2024-07-03 23:34:38 -07:00
03_gemm_bias_relu
Split the instances by architecture. (#1223)
2024-04-02 09:42:17 -07:00
04_gemm_add_add_fastgelu
remove support for gfx940 and gfx941 targets (#1944)
2025-03-05 11:07:33 -08:00
09_convnd_fwd
Add a daily CI build on gfx908. (#1987)
2025-03-17 18:08:53 -07:00
10_convnd_fwd_multiple_d_multiple_reduce
Fix example_convnd_fwd_max_xdl_int8 failures on MI300 (#1666)
2024-11-14 08:40:50 -08:00
12_reduce
Support large: 12d tensor size for reduction kenrel (#1465)
2024-08-13 16:15:47 +02:00
13_pool2d_fwd
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
14_gemm_quantization
Split the instances by architecture. (#1223)
2024-04-02 09:42:17 -07:00
15_grouped_gemm
Post-merge changes for fully async args copy in ck grouped gemm (#1991)
2025-04-03 13:35:43 +02:00
16_gemm_multi_d_multi_reduces
Fix example_convnd_fwd_max_xdl_int8 failures on MI300 (#1666)
2024-11-14 08:40:50 -08:00
17_convnd_bwd_data
Add Grouped Conv Fwd Large Tensor kernel (#1432)
2024-08-06 10:06:10 +02:00
18_batched_gemm_reduce
remove support for gfx940 and gfx941 targets (#1944)
2025-03-05 11:07:33 -08:00
19_binary_elementwise
Refactor elementwise kernels (#1222)
2024-04-19 13:31:17 +02:00
20_grouped_conv_bwd_weight
Apply universal gemm to bwd_weight_cshuffle operator (#1873)
2025-02-18 10:10:22 +01:00
21_gemm_layernorm
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
22_cgemm
Clean DTYPES conditions in CMake (#974)
2023-10-18 11:14:14 -05:00
23_softmax
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
24_batched_gemm
CK pk_i4_t test failures fix (SWDEV-518629) (#2075)
2025-04-14 16:58:57 +08:00
25_gemm_bias_e_permute
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
26_contraction
Code clean-up (#1285)
2024-05-10 09:41:39 -07:00
27_layernorm2d_fwd
Split the static library into several files. (#1044)
2023-11-28 11:17:37 -08:00
28_grouped_gemm_bias_e_permute
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
29_batched_gemm_bias_e_permute
Merging the gfx12 code into public repo. (#1362)
2024-06-27 00:33:34 -07:00
30_grouped_conv_fwd_multiple_d
Remove CK_USE_AMD_MFMA_GFX950 (#1935)
2025-03-04 10:32:25 -08:00
31_batched_gemm_gemm
Merge from internal (#1857)
2025-02-07 15:05:05 -07:00
32_batched_gemm_scale_softmax_gemm
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
33_multiple_reduce
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
34_batchnorm
Refactor elementwise kernels (#1222)
2024-04-19 13:31:17 +02:00
35_splitK_gemm
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
36_sparse_embedding
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
37_batched_gemm_add_add_relu_gemm_add
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
38_grouped_conv_bwd_data_multiple_d
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
39_permute
Clean DTYPES conditions in CMake (#974)
2023-10-18 11:14:14 -05:00
40_conv2d_fwd_quantization
Split the instances by architecture. (#1223)
2024-04-02 09:42:17 -07:00
41_grouped_conv_conv_fwd
Merge from internal (#1857)
2025-02-07 15:05:05 -07:00
42_groupnorm_fwd
Split the static library into several files. (#1044)
2023-11-28 11:17:37 -08:00
43_splitk_gemm_bias_e_permute
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
44_elementwise_permute
Prevent instantiation of undefined FP8 operators. (#1639)
2024-11-05 13:58:29 -08:00
45_elementwise_normalization
Layernorm and groupnorm support to save mean and inverse std in forward (#929)
2023-10-19 07:36:29 +08:00
46_gemm_add_multiply
Code clean-up (#1285)
2024-05-10 09:41:39 -07:00
47_gemm_bias_softmax_gemm_permute
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
48_pool3d_fwd
Fixing most of the cppcheck errors. (#1142)
2024-01-24 13:47:48 -08:00
49_maxpool2d_bwd
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
50_put_element
Refactoring cmake files to build data types separately. (#932)
2023-09-20 22:15:56 -07:00
51_avgpool3d_bwd
Fixing most of the cppcheck errors. (#1142)
2024-01-24 13:47:48 -08:00
52_im2col_col2im
Split the instances by architecture. (#1223)
2024-04-02 09:42:17 -07:00
53_layernorm2d_bwd
layernorm and groupnorm backward data (#1083)
2023-12-19 04:23:11 +08:00
54_groupnorm_bwd
layernorm and groupnorm backward data (#1083)
2023-12-19 04:23:11 +08:00
59_grouped_gemm_multi_ABD
OCP FP8 support for gfx12. (#1710)
2024-12-03 08:42:55 -08:00
60_gemm_multi_ABD
bf16A_Int8B with fastgelu/bias (#1264)
2024-04-26 07:26:30 -05:00
61_contraction_multi_ABD
add gemm_bias_add example (#1361)
2024-07-11 18:08:07 -07:00
62_convnd_activ
remove support for gfx940 and gfx941 targets (#1944)
2025-03-05 11:07:33 -08:00
63_layernorm4d_fwd
Split the static library into several files. (#1044)
2023-11-28 11:17:37 -08:00
64_fpAintB_gemm
Split the instances by architecture. (#1223)
2024-04-02 09:42:17 -07:00
65_gemm_multiply_multiply
Improve the general performance of the Preshuffled GEMM V3 & delete the unnecessary instances (#2166)
2025-05-12 09:52:58 -07:00
66_complex_contraction_bilinear
update layernorm (#1570)
2024-10-22 09:26:18 +08:00
67_gemm_microscaling
MX GEMM - Add FP8 GEMM Tests for Different Layouts (#2152)
2025-05-01 11:55:48 -06:00
ck_tile
[CK_TILE] Add logits soft-capping & customization support to the FMHA forward kernel/pipelines (#2163)
2025-05-13 12:19:25 +08:00
CMakeLists.txt
Revert "Add ck tile examples to package (#1880)" (#2150)
2025-04-30 10:20:16 -07:00
README.md
Add basic documentation structure (#1715)
2024-12-04 00:46:47 +01:00

README.md

Back to the main page

Composable Kernel examples

Reference in New Issue View Git Blame Copy Permalink