Ville Pietilä e962a41638 Automatic deduction of split-K value for grouped convolution (#2491) ...

* Split-K autodeduction for DeviceGroupedConvBwdWeight_Xdl_CShuffle and DeviceGroupedConvBwdWeight_Xdl_CShuffleV3.

* Split-K autodeduction for DeviceGroupedConvBwdWeightTwoStage_Xdl_CShuffle.

* Use simple best occupancy model to calculate the split-K.

* Handle split-K autodeduction in explicit gemm conv.

* Add unit tests for split-K autodeduction.

* Remove oversubscription.

* Small fixes.

* Added split-K autodeduction for DeviceGroupedConvBwdWeightMultipleD_Xdl_CShuffle.

* Run clang formatting.

* Fix error handling in the conv profiler.

* Add missing documentation for the autodeducted split-K values.

* Add split-K autodeduction to DeviceGroupedConvBwdWeight_Explicit_Xdl solver.

* Fix clang formatting and split-K profiler documentation.

* Rename max_occupancy value variable.

* Calculate grid size for split-K autodeduction directly from input array shapes and template params.

---------

Co-authored-by: Ville Pietilä <>

2025-07-31 12:08:45 +02:00

..

data_type_enum.hpp

Pool2d max/avg kernel in the BWD version (#1494)

2024-09-12 11:47:52 +02:00

profile_avg_pool2d_bwd_impl.hpp

Pool2d max/avg kernel in the BWD version (#1494)

2024-09-12 11:47:52 +02:00

profile_avg_pool3d_bwd_impl.hpp

MaxPool & AvgPool bwd instances, test, ckProfiler, client example (#861)

2023-08-31 21:01:50 +08:00

profile_batched_gemm_add_relu_gemm_add_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_batched_gemm_b_scale_impl.hpp

Added Int4 mixed batch gemm support (#1839)

2025-02-10 11:17:02 +08:00

profile_batched_gemm_bias_softmax_gemm_permute_impl.hpp

OCP FP8 support for gfx12. (#1710)

2024-12-03 08:42:55 -08:00

profile_batched_gemm_gemm_impl.hpp

OCP FP8 support for gfx12. (#1710)

2024-12-03 08:42:55 -08:00

profile_batched_gemm_impl.hpp

Fix argument order for calls to profile_batched_gemm_impl() (#2277)

2025-06-17 19:29:09 -07:00

profile_batched_gemm_reduce_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_batched_gemm_softmax_gemm_impl.hpp

OCP FP8 support for gfx12. (#1710)

2024-12-03 08:42:55 -08:00

profile_batched_gemm_softmax_gemm_permute_impl.hpp

OCP FP8 support for gfx12. (#1710)

2024-12-03 08:42:55 -08:00

profile_batchnorm_backward_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_batchnorm_forward_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_batchnorm_infer_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_contraction_impl.hpp

Extend support for contraction 6D (#1207)

2024-04-09 23:46:21 +02:00

profile_contraction_utils.hpp

Extend support for contraction 6D (#1207)

2024-04-09 23:46:21 +02:00

profile_conv_bwd_data_impl.hpp

upgrade from clang-format-12 to clang-format-18 (#2568)

2025-07-28 11:34:07 -07:00

profile_conv_fwd_bias_relu_add_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_conv_fwd_bias_relu_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_conv_fwd_impl.hpp

upgrade from clang-format-12 to clang-format-18 (#2568)

2025-07-28 11:34:07 -07:00

profile_conv_tensor_rearrange_impl.hpp

upgrade from clang-format-12 to clang-format-18 (#2568)

2025-07-28 11:34:07 -07:00

profile_elementwise_layernorm_impl.hpp

Clip fp8 to +/-240 on all targets. (#1172)

2024-02-27 14:31:05 -06:00

profile_gemm_ab_scale_impl.hpp

[GEMM] F8 GEMM, performance optimized. (#1384)

2024-07-19 22:06:52 +08:00

profile_gemm_add_add_fastgelu_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_add_fastgelu_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_add_impl.hpp

Add support for mixed-precision f16bf16_int8 gemm (#1127)

2024-02-07 15:54:13 +01:00

profile_gemm_add_multiply_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_add_relu_add_layernorm_impl.hpp

Layernorm and groupnorm support to save mean and inverse std in forward (#929)

2023-10-19 07:36:29 +08:00

profile_gemm_add_relu_impl.hpp

Add support for mixed-precision f16bf16_int8 gemm (#1127)

2024-02-07 15:54:13 +01:00

profile_gemm_add_silu_impl.hpp

Add support for mixed-precision f16bf16_int8 gemm (#1127)

2024-02-07 15:54:13 +01:00

profile_gemm_b_scale_impl.hpp

Support b_scale: (#2350)

2025-07-24 18:49:58 -07:00

profile_gemm_bias_add_reduce_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_bilinear_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_blockscale_wp_impl.hpp

Add MoE & FP8 Blockscale WP Kernels for GFX950 (#2297)

2025-06-12 09:25:59 +08:00

profile_gemm_fastgelu_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_impl.hpp

Fix build errors on windows (#2456)

2025-07-16 07:58:23 -07:00

profile_gemm_multiply_add_impl.hpp

fixed fp8 issues (#894)

2023-09-12 22:17:56 -05:00

profile_gemm_multiply_multiply_impl.hpp

[A8W8 GEMM] Optimized weight-preshuffled implementation & add quantization datatype for CK TILE rms_norm (#1862)

2025-02-20 14:00:27 -08:00

profile_gemm_multiply_multiply_wp_impl.hpp

[Block Scale GEMM] Optimized block scale gemm (#1950)

2025-03-11 10:11:21 -07:00

profile_gemm_mx_impl.hpp

MX GEMM - Add FP6 GEMM Test (#2488)

2025-07-11 15:32:12 -06:00

profile_gemm_reduce_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_splitk_impl.hpp

[GEMM] Optimization for MI200/300. (#1135)

2024-01-19 07:02:22 -06:00

profile_gemm_streamk_impl.hpp

add generic instances (#858)

2023-08-23 09:18:10 -05:00

profile_gemm_universal_batched_impl.hpp

Add SplitK support into Batched GEMM V3 (#1729)

2024-12-13 21:08:35 +01:00

profile_gemm_universal_impl.hpp

WMMA GEMM universal pipeline v1, mixed precision and paddings, examples (#2230)

2025-06-04 12:22:33 +06:00

profile_gemm_universal_preshuffle_impl.hpp

[ckProfiler] Add infrastructure and instances to profile gemm_universal with B preshuffle (#2427)

2025-07-01 18:34:52 -07:00

profile_gemm_universal_reduce_impl.hpp

Universal gemm splitk using reduce (with multi-d) (#1341)

2024-07-19 22:01:22 +08:00

profile_gemm_universal_streamk_impl.hpp

Stream-K CkProfiler Update ( Replace CPU Validation with GPU Validation and Add Dynamic Grid Size Calculation for Stream-K GEMM Profiler) (#2333)

2025-06-18 07:49:22 -07:00

profile_grouped_conv_bwd_data_impl.hpp

upgrade from clang-format-12 to clang-format-18 (#2568)

2025-07-28 11:34:07 -07:00

profile_grouped_conv_bwd_weight_impl.hpp

Automatic deduction of split-K value for grouped convolution (#2491)

2025-07-31 12:08:45 +02:00

profile_grouped_conv_fwd_bias_clamp_impl.hpp

upgrade from clang-format-12 to clang-format-18 (#2568)

2025-07-28 11:34:07 -07:00

profile_grouped_conv_fwd_impl.hpp

upgrade from clang-format-12 to clang-format-18 (#2568)

2025-07-28 11:34:07 -07:00

profile_grouped_conv_fwd_outelementop_impl.hpp

upgrade from clang-format-12 to clang-format-18 (#2568)

2025-07-28 11:34:07 -07:00

profile_grouped_gemm_fastgelu_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_grouped_gemm_fixed_nk_impl.hpp

Split env.hpp header from the ck.hpp header. (#2049)

2025-04-03 15:30:21 -07:00

profile_grouped_gemm_impl.hpp

Split env.hpp header from the ck.hpp header. (#2049)

2025-04-03 15:30:21 -07:00

profile_grouped_gemm_multiply_tile_loop_impl.hpp

Split env.hpp header from the ck.hpp header. (#2049)

2025-04-03 15:30:21 -07:00

profile_grouped_gemm_tile_loop_impl.hpp

Split env.hpp header from the ck.hpp header. (#2049)

2025-04-03 15:30:21 -07:00

profile_groupnorm_bwd_data_impl.hpp

layernorm and groupnorm backward data (#1083)

2023-12-19 04:23:11 +08:00

profile_groupnorm_bwd_gamma_beta_impl.hpp

layernorm & groupnorm bwd gamma beta (#1133)

2024-01-25 19:53:15 +08:00

profile_groupnorm_fwd_impl.hpp

Layernorm4d (#1022)

2023-11-09 08:34:51 +08:00

profile_layernorm_bwd_data_impl.hpp

layernorm and groupnorm backward data (#1083)

2023-12-19 04:23:11 +08:00

profile_layernorm_bwd_gamma_beta_impl.hpp

layernorm & groupnorm bwd gamma beta (#1133)

2024-01-25 19:53:15 +08:00

profile_layernorm_fwd_impl.hpp

Layernorm4d (#1022)

2023-11-09 08:34:51 +08:00

profile_max_pool2d_bwd_impl.hpp

Pool2d max/avg kernel in the BWD version (#1494)

2024-09-12 11:47:52 +02:00

profile_max_pool3d_bwd_impl.hpp

MaxPool & AvgPool bwd instances, test, ckProfiler, client example (#861)

2023-08-31 21:01:50 +08:00

profile_permute_scale_impl.hpp

Introduce combined elementwise ops (#1217)

2024-04-02 17:23:49 -05:00

profile_pool2d_fwd_impl.hpp

Rewrite pool2d fwd (#1462)

2024-09-11 15:21:00 +02:00

profile_pool3d_fwd_impl.hpp

Generic threshold calculation after merge fixes (#1618)

2024-11-06 10:44:58 +01:00

profile_reduce_impl.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_softmax_impl.hpp

upgrade from clang-format-12 to clang-format-18 (#2568)

2025-07-28 11:34:07 -07:00

profile_transpose_impl.hpp

Refactor elementwise kernels (#1222)

2024-04-19 13:31:17 +02:00