ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-11 17:00:18 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
c1badfd30c1679f4c8e176c8f0608db2c6ac6505
composable_kernel/include/ck/tensor_operation/gpu/grid
History
huaiguxu c1badfd30c Handle moe_fp8 no-mainloop cases. Supprese no-mainloop check (#2438) 
Co-authored-by: felix <felix.li@amd.com>
2025-07-16 15:44:34 +08:00
..
batchnorm_multiblock
Do not use warpSize as compile time constant as it is removed (#2320)
2025-06-17 11:54:30 -07:00
gemm_layernorm
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
normalization
layernorm and groupnorm backward data (#1083)
2023-12-19 04:23:11 +08:00
block_to_ctile_map.hpp
Grouped conv bwd weight with grouped gemm (#2304)
2025-06-12 10:15:07 +02:00
gridwise_2d_multiple_reduction_multiblock.hpp
Fix for beta!=0 in reduce (#1440)
2024-08-06 09:10:39 -07:00
gridwise_2d_multiple_reduction_threadwise.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_2d_reduction_multiblock.hpp
Fix for beta!=0 in reduce (#1440)
2024-08-06 09:10:39 -07:00
gridwise_2d_reduction_threadwise_multi_d.hpp
Universal gemm splitk using reduce (with multi-d) (#1341)
2024-07-19 22:01:22 +08:00
gridwise_2d_reduction_threadwise.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_batched_gemm_gemm_xdl_cshuffle_v1.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_batched_gemm_multiple_d_gemm_multiple_d_xdl_cshuffle_v1.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_batched_gemm_multiple_d_softmax_gemm_xdl_cshuffle_v1.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_batched_gemm_softmax_gemm_wmma_cshuffle.hpp
Merging the gfx12 code into public repo. (#1362)
2024-06-27 00:33:34 -07:00
gridwise_batched_gemm_softmax_gemm_xdl_cshuffle_v1.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_batchnorm_backward_blockwise_welford.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_batchnorm_forward_blockwise_welford.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_elementwise_1d_scale.hpp
Refactor elementwise kernels (#1222)
2024-04-19 13:31:17 +02:00
gridwise_elementwise_2d.hpp
Grouped conv backward data GKCYX support (#2029)
2025-04-01 13:24:38 -07:00
gridwise_elementwise_layernorm_welford_variance.hpp
enable compilation of INSTANCES_ONLY for Windows (#1082)
2023-12-20 14:34:53 -08:00
gridwise_fpAintB_gemm_wmma.hpp
Merging the gfx12 code into public repo. (#1362)
2024-06-27 00:33:34 -07:00
gridwise_gemm_bias_add_reduce_xdl_cshuffle_v1.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_dl_multiple_d.hpp
Add Grouped Conv Fwd Large Tensor kernel (#1432)
2024-08-06 10:06:10 +02:00
gridwise_gemm_dl_v1r3.hpp
Add Grouped Conv Fwd Large Tensor kernel (#1432)
2024-08-06 10:06:10 +02:00
gridwise_gemm_dpp.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_multiple_abd_xdl_cshuffle.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_multiple_d_multiple_r_xdl_cshuffle.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_multiple_d_wmma_cshuffle.hpp
Statically Cast Pointer Offset (#1631)
2024-11-05 09:59:08 -08:00
gridwise_gemm_multiple_d_xdl_cshuffle_lds_direct_load.hpp
Optimized GEMMs for MX FP4/8 (#2294)
2025-06-05 13:54:15 -06:00
gridwise_gemm_multiple_d_xdl_cshuffle.hpp
Grouped convolution forward with clamp (#2334)
2025-06-16 15:36:53 +02:00
gridwise_gemm_multiple_d_xdl_splitk_cshuffle.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_pipeline_selector.hpp
Rebase the PR #1520 to ROCm repo. (#1574)
2025-02-20 18:58:14 -08:00
gridwise_gemm_pipeline_v1.hpp
Navi3 rel (#1176)
2024-03-08 17:11:51 -08:00
gridwise_gemm_pipeline_v2.hpp
Fixed Gemmv2r3 kpad (#938)
2023-09-26 18:40:00 -05:00
gridwise_gemm_pipeline_v3.hpp
initial stream-k implementation with example (#699)
2023-07-26 14:18:15 -05:00
gridwise_gemm_pipeline_v4_direct_load.hpp
Add support for double buffering in direct load GEMM kernel (#1052)
2023-12-03 23:08:47 +01:00
gridwise_gemm_reduce_xdl_cshuffle_v1.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_split_k_multiple_d_xdl_cshuffle_v2.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_split_k_multiple_d_xdl_cshuffle.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_waveletmodel.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_gemm_wmma_cshuffle_v3.hpp
WMMA GEMM universal pipeline v1, mixed precision and paddings, examples (#2230)
2025-06-04 12:22:33 +06:00
gridwise_gemm_wmma.hpp
Merging the gfx12 code into public repo. (#1362)
2024-06-27 00:33:34 -07:00
gridwise_gemm_xdl_cshuffle_conv_v3.hpp
Grouped Convolution Backward Weight Explicit GEMM (#2282)
2025-06-06 10:30:08 +02:00
gridwise_gemm_xdl_cshuffle_streamk_v3.hpp
Fix Add in dynamic buffer for fp32/i8 (#2351)
2025-06-17 22:25:56 +02:00
gridwise_gemm_xdl_cshuffle_v1.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_xdl_cshuffle_v2.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_xdl_cshuffle_v3_b_preshuffle.hpp
Do not use warpSize as compile time constant as it is removed (#2320)
2025-06-17 11:54:30 -07:00
gridwise_gemm_xdl_cshuffle_v3_b_scale.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_xdl_cshuffle_v3_multi_abd.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_xdl_cshuffle_v3_multi_d_ab_scale.hpp
Add MoE & FP8 Blockscale WP Kernels for GFX950 (#2297)
2025-06-12 09:25:59 +08:00
gridwise_gemm_xdl_cshuffle_v3_multi_d_b_preshuffle.hpp
Fix clang in ck develop branch (#2445)
2025-07-02 10:07:47 -06:00
gridwise_gemm_xdl_cshuffle_v3_multi_d_blockscale_b_preshuffle.hpp
Do not use warpSize as compile time constant as it is removed (#2320)
2025-06-17 11:54:30 -07:00
gridwise_gemm_xdl_cshuffle_v3_multi_d.hpp
Grouped Convolution Backward Weight Explicit GEMM (#2282)
2025-06-06 10:30:08 +02:00
gridwise_gemm_xdl_cshuffle_v3_mx_bpreshuffle.hpp
Do not use warpSize as compile time constant as it is removed (#2320)
2025-06-17 11:54:30 -07:00
gridwise_gemm_xdl_cshuffle_v3_mx.hpp
MX GEMM - FP6 Example (#2419)
2025-07-07 10:33:26 -06:00
gridwise_gemm_xdl_cshuffle_v3.hpp
Grouped convolution forward with clamp (#2334)
2025-06-16 15:36:53 +02:00
gridwise_gemm_xdl_layernorm_cshuffle_v1.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_xdl_waveletmodel_cshuffle.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_xdlops_bwd_weight.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_xdlops_skip_b_lds_v1.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_splitk_lds_direct_load.hpp
Optimized GEMMs for MX FP4/8 (#2294)
2025-06-05 13:54:15 -06:00
gridwise_gemm_xdlops_streamk.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_v2r3.hpp
Change flag to CK_GFX90A_DENORM_WORKAROUND (#1817)
2025-01-28 09:58:39 -05:00
gridwise_gemm_xdlops_v2r4.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_v2r4r2.hpp
Split env.hpp header from the ck.hpp header. (#2049)
2025-04-03 15:30:21 -07:00
gridwise_gemm_xdlops_v3r1.hpp
Use new mfma instructions for FP8 on gfx950 (#2202)
2025-05-19 17:29:51 -07:00
gridwise_gemm_xdlops_v3r2.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_v3r3.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_moe_gemm_blockscale.hpp
Do not use warpSize as compile time constant as it is removed (#2320)
2025-06-17 11:54:30 -07:00
gridwise_moe_gemm.hpp
Handle moe_fp8 no-mainloop cases. Supprese no-mainloop check (#2438)
2025-07-16 15:44:34 +08:00
gridwise_moe_mx_gemm_bns.hpp
Do not use warpSize as compile time constant as it is removed (#2320)
2025-06-17 11:54:30 -07:00
gridwise_moe_mx_gemm_bpreshuffle.hpp
[CK] Mxfp4 moe blockscale buf2lds version support (#2455)
2025-07-06 15:42:00 +08:00
gridwise_moe_mx_gemm.hpp
[CK] Mxfp4 moe blockscale buf2lds version support (#2455)
2025-07-06 15:42:00 +08:00
gridwise_permute.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_put_element_1d.hpp
Average pool backward deviceOP and example (#797)
2023-08-10 12:04:35 +08:00
gridwise_set_buffer_value.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_set_multiple_buffer_value.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_softmax.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_sparse_embeddings_forward_layernorm_builtins.hpp
Replace buffer load/store intrinsics with builtins (#1876)
2025-03-05 14:33:28 -08:00
gridwise_sparse_embeddings_forward_layernorm.hpp
[HotFix] add config and version files to pass on build info (#856)
2023-08-23 11:36:17 -07:00
gridwise_tensor_rearrange.hpp
Statically Cast Pointer Offset (#1631)
2024-11-05 09:59:08 -08:00