ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-17 11:30:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
a00705b4fd3587b964c1a69a08124f4a5bfb9320
composable_kernel/include/ck/tensor_operation/gpu/grid
History
yinglu 19463895a8 TF32 POC in Conv3d on MI30x platform #2763 (second attempt) (#2852) 
* Revert "Revert "feature:tf32:add initial conv3d fwd kernel support (#2763)" (#2848)"

This reverts commit 954db22b39.

* fix compile error on gf12x

* only run tf32 example on gfx942

* only build tf32 instance on gfx942

* ckProfiler:only support tf32 in gfx942

* delete unuseful messages

[ROCm/composable_kernel commit: dd7af118d7]
2025-09-17 14:50:15 -07:00
..
batchnorm_multiblock
Do not use warpSize as compile time constant as it is removed (#2320)
2025-06-17 11:54:30 -07:00
gemm_layernorm
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
normalization
upgrade from clang-format-12 to clang-format-18 (#2568)
2025-07-28 11:34:07 -07:00
block_to_ctile_map.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_2d_multiple_reduction_multiblock.hpp
Fix for beta!=0 in reduce (#1440)
2024-08-06 09:10:39 -07:00
gridwise_2d_multiple_reduction_threadwise.hpp
…
gridwise_2d_reduction_multiblock.hpp
Fix for beta!=0 in reduce (#1440)
2024-08-06 09:10:39 -07:00
gridwise_2d_reduction_threadwise_multi_d.hpp
upgrade from clang-format-12 to clang-format-18 (#2568)
2025-07-28 11:34:07 -07:00
gridwise_2d_reduction_threadwise.hpp
…
gridwise_batched_gemm_gemm_wmma_cshuffle_v3.hpp
Disable GridwiseOp prints if env var is off (#2843)
2025-09-16 17:47:28 +02:00
gridwise_batched_gemm_gemm_xdl_cshuffle_v1.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_batched_gemm_multiple_d_gemm_multiple_d_xdl_cshuffle_v1.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_batched_gemm_multiple_d_softmax_gemm_xdl_cshuffle_v1.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_batched_gemm_softmax_gemm_wmma_cshuffle.hpp
Disable GridwiseOp prints if env var is off (#2843)
2025-09-16 17:47:28 +02:00
gridwise_batched_gemm_softmax_gemm_xdl_cshuffle_v1.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_batchnorm_backward_blockwise_welford.hpp
…
gridwise_batchnorm_forward_blockwise_welford.hpp
…
gridwise_elementwise_1d_scale.hpp
…
gridwise_elementwise_2d.hpp
upgrade from clang-format-12 to clang-format-18 (#2568)
2025-07-28 11:34:07 -07:00
gridwise_elementwise_layernorm_welford_variance.hpp
…
gridwise_fpAintB_gemm_wmma.hpp
Disable GridwiseOp prints if env var is off (#2843)
2025-09-16 17:47:28 +02:00
gridwise_gemm_bias_add_reduce_xdl_cshuffle_v1.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_dl_multiple_d.hpp
Add Grouped Conv Fwd Large Tensor kernel (#1432)
2024-08-06 10:06:10 +02:00
gridwise_gemm_dl_v1r3.hpp
upgrade from clang-format-12 to clang-format-18 (#2568)
2025-07-28 11:34:07 -07:00
gridwise_gemm_dpp.hpp
Remove !defined(__HIP_DEVICE_COMPILE__) in CK kernel (#2564)
2025-07-28 13:01:07 -07:00
gridwise_gemm_multiple_abd_xdl_cshuffle.hpp
TF32 POC in Conv3d on MI30x platform #2763 (second attempt) (#2852)
2025-09-17 14:50:15 -07:00
gridwise_gemm_multiple_d_multiple_r_xdl_cshuffle.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_multiple_d_wmma_cshuffle.hpp
Disable GridwiseOp prints if env var is off (#2843)
2025-09-16 17:47:28 +02:00
gridwise_gemm_multiple_d_xdl_cshuffle_lds_direct_load.hpp
TF32 POC in Conv3d on MI30x platform #2763 (second attempt) (#2852)
2025-09-17 14:50:15 -07:00
gridwise_gemm_multiple_d_xdl_cshuffle.hpp
TF32 POC in Conv3d on MI30x platform #2763 (second attempt) (#2852)
2025-09-17 14:50:15 -07:00
gridwise_gemm_multiple_d_xdl_splitk_cshuffle.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_pipeline_selector.hpp
Rebase the PR #1520 to ROCm repo. (#1574)
2025-02-20 18:58:14 -08:00
gridwise_gemm_pipeline_v1.hpp
…
gridwise_gemm_pipeline_v2.hpp
…
gridwise_gemm_pipeline_v3.hpp
…
gridwise_gemm_pipeline_v4_direct_load.hpp
…
gridwise_gemm_reduce_xdl_cshuffle_v1.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_split_k_multiple_d_xdl_cshuffle_v2.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_split_k_multiple_d_xdl_cshuffle.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_waveletmodel.hpp
…
gridwise_gemm_wmma_cshuffle_v3_b_scale.hpp
Wmma support for multiple Ds based GEMMs (#2613)
2025-09-05 16:31:08 +02:00
gridwise_gemm_wmma_cshuffle_v3_common.hpp
Added wmma support for gemm quantization: (#2841)
2025-09-16 16:23:29 -07:00
gridwise_gemm_wmma_cshuffle_v3.hpp
Wmma support for multiple Ds based GEMMs (#2613)
2025-09-05 16:31:08 +02:00
gridwise_gemm_wmma.hpp
Disable GridwiseOp prints if env var is off (#2843)
2025-09-16 17:47:28 +02:00
gridwise_gemm_xdl_cshuffle_conv_v3.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_streamk_v3.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v1.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v2.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v3_b_preshuffle.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v3_b_scale.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v3_multi_abd.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v3_multi_d_ab_scale.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v3_multi_d_b_preshuffle.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v3_multi_d_blockscale_b_preshuffle.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v3_multi_d.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v3_mx_bpreshuffle.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v3_mx.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_cshuffle_v3.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_layernorm_cshuffle_v1.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdl_waveletmodel_cshuffle.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdlops_bwd_weight.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdlops_skip_b_lds_v1.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdlops_splitk_lds_direct_load.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdlops_streamk.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdlops_v2r3.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdlops_v2r4.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdlops_v2r4r2.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdlops_v3r1.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdlops_v3r2.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_gemm_xdlops_v3r3.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_moe_gemm_blockscale.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_moe_gemm.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_moe_mx_gemm_bns.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_moe_mx_gemm_bpreshuffle.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_moe_mx_gemm.hpp
Extend XDL kernel to Support RDNA3/4 - Part 3 (#2723)
2025-09-09 11:22:36 +08:00
gridwise_permute.hpp
upgrade from clang-format-12 to clang-format-18 (#2568)
2025-07-28 11:34:07 -07:00
gridwise_put_element_1d.hpp
…
gridwise_set_buffer_value.hpp
…
gridwise_set_multiple_buffer_value.hpp
…
gridwise_softmax.hpp
…
gridwise_sparse_embeddings_forward_layernorm_builtins.hpp
Replace buffer load/store intrinsics with builtins (#1876)
2025-03-05 14:33:28 -08:00
gridwise_sparse_embeddings_forward_layernorm.hpp
…
gridwise_tensor_rearrange.hpp
Remove !defined(__HIP_DEVICE_COMPILE__) in CK kernel (#2564)
2025-07-28 13:01:07 -07:00