ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-14 02:02:46 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
51886bf22b3b36d668df2fbeab2da2642105a529
composable_kernel/example
History
Linjun-AMD 51886bf22b Add attention sink support for FMHA FWD (#3368) 
* Revert "Revert "Add attn sink (#2892)" (#3250)"

This reverts commit e3be392d13e6ee107d823af32aca2d3ff03ca69d.

* fix conflict

Signed-off-by: Linjun-AMD <Jun.Lin@amd.com>

* Add F_sink parameter to FmhaFwdPipeline

* Update tile_fmha_traits.hpp

* Refactor pipeline creation in fmha_fwd.py

Updated the pipeline creation logic to include 'sink' parameter in product combinations and adjusted the FmhaFwdPipeline calls accordingly.

* Update fmha_fwd.py

* Update fmha_fwd.py

* Update example/ck_tile/01_fmha/script/correct_test_fwd_sink.sh

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* update CHANGELOG.md

Signed-off-by: Linjun-AMD <Jun.Lin@amd.com>

* Update CHANGELOG with new features and support

* Update fmha_fwd.hpp

* Update CHANGELOG.md

* Update smoke_test_fwd_sink.sh

* Update correct_test_fwd_sink.sh

* Update smoke_test_fwd_sink.sh

---------

Signed-off-by: Linjun-AMD <Jun.Lin@amd.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

[ROCm/composable_kernel commit: f5573f56d9]
2025-12-15 12:21:59 +08:00
..
01_gemm
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
02_gemm_bilinear
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
03_gemm_bias_relu
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
04_gemm_add_add_fastgelu
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
09_convnd_fwd
[CK, CK_TILE] Add GPU Reference Implementations for Grouped Convolution (#3216)
2025-12-03 21:14:21 +02:00
10_convnd_fwd_multiple_d_multiple_reduce
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
11_convnd_fwd_bias
[DOCS] Documentation Addition (Readme updates) (#2495)
2025-10-16 03:10:57 -07:00
12_reduce
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
13_pool2d_fwd
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
14_gemm_quantization
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
15_grouped_gemm
Add grouped gemm instances for RDNA4 (#3237)
2025-12-01 15:32:10 -08:00
16_gemm_multi_d_multi_reduces
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
17_convnd_bwd_data
[CK, CK_TILE] Add GPU Reference Implementations for Grouped Convolution (#3216)
2025-12-03 21:14:21 +02:00
18_batched_gemm_reduce
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
19_binary_elementwise
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
20_grouped_conv_bwd_weight
[CK, CK_TILE] Add GPU Reference Implementations for Grouped Convolution (#3216)
2025-12-03 21:14:21 +02:00
21_gemm_layernorm
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
22_cgemm
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
23_softmax
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
24_batched_gemm
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
25_gemm_bias_e_permute
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
26_contraction
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
27_layernorm2d_fwd
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
28_grouped_gemm_bias_e_permute
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
29_batched_gemm_bias_e_permute
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
30_grouped_conv_fwd_multiple_d
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
31_batched_gemm_gemm
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
32_batched_gemm_scale_softmax_gemm
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
33_multiple_reduce
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
34_batchnorm
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
35_splitK_gemm
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
36_sparse_embedding
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
37_batched_gemm_add_add_relu_gemm_add
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
38_grouped_conv_bwd_data_multiple_d
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
39_permute
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
40_conv2d_fwd_quantization
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
41_grouped_conv_conv_fwd
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
42_groupnorm_fwd
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
43_splitk_gemm_bias_e_permute
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
44_elementwise_permute
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
45_elementwise_normalization
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
46_gemm_add_multiply
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
47_gemm_bias_softmax_gemm_permute
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
48_pool3d_fwd
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
49_maxpool2d_bwd
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
50_put_element
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
51_avgpool3d_bwd
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
52_im2col_col2im
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
53_layernorm2d_bwd
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
54_groupnorm_bwd
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
59_grouped_gemm_multi_ABD
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
60_gemm_multi_ABD
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
61_contraction_multi_ABD
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
62_convnd_activ
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
63_layernorm4d_fwd
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
64_fpAintB_gemm
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
65_gemm_multiply_multiply
Wmma support for gemm_ab_scale (#3314)
2025-12-11 09:06:20 +01:00
66_complex_contraction_bilinear
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
67_gemm_microscaling
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
68_gemm_add
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
69_gemm_add_relu
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
ck_tile
Add attention sink support for FMHA FWD (#3368)
2025-12-15 12:21:59 +08:00
CMakeLists.txt
chore(copyright) update library wide CMakeLists.txt copyright header template (#3313)
2025-11-28 13:49:54 -08:00
README.md
Add basic documentation structure (#1715)
2024-12-04 00:46:47 +01:00
test_old_ck_gpu_reference.cpp
chore: update copyright header for misc files (#3402)
2025-12-11 08:25:29 -08:00

README.md

Back to the main page

Composable Kernel examples

Reference in New Issue View Git Blame Copy Permalink