Bartłomiej Kocot 4094ad158a Integrate universal gemm with conv bwd data and add SplitK (#1315) ...

* Integrate universal gemm with conv bwd data

* Fix multi d kernel

* Add splitK support

* instances refactor

* instances refactor

* refactor

* fixeS

* fixes

* 16x16 instnaces

* Fixes

* Fix

* Fix

* Fix

* Fix

* Fix

* Fixes

* fix

* fix

2025-04-28 23:54:49 +02:00

..

CMakeLists.txt

DeviceGemm_Wmma_CShuffleV3 with BlockGemmPipelineVersion::v3 (#2096)

2025-04-28 10:14:21 +05:00

profile_avg_pool2d_bwd.cpp

Pool2d max/avg kernel in the BWD version (#1494)

2024-09-12 11:47:52 +02:00

profile_avg_pool3d_bwd.cpp

MaxPool & AvgPool bwd instances, test, ckProfiler, client example (#861)

2023-08-31 21:01:50 +08:00

profile_batched_gemm_add_relu_gemm_add.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_batched_gemm_b_scale.cpp

Added Int4 mixed batch gemm support (#1839)

2025-02-10 11:17:02 +08:00

profile_batched_gemm_gemm.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_batched_gemm_multi_d.cpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

profile_batched_gemm_reduce.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_batched_gemm.cpp

Add DeviceBatchedGemmMultipleD_Dl (#732)

2023-06-12 08:37:15 -05:00

profile_batchnorm_bwd.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_batchnorm_fwd.cpp

Batchnorm splitk single kernel (#771)

2023-07-06 10:58:55 -05:00

profile_batchnorm_infer.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_contraction_bilinear.cpp

Extend support for contraction 6D (#1207)

2024-04-09 23:46:21 +02:00

profile_contraction_scale.cpp

Extend support for contraction 6D (#1207)

2024-04-09 23:46:21 +02:00

profile_conv_bwd_data.cpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

profile_conv_fwd_bias_relu_add.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_conv_fwd_bias_relu.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_conv_fwd.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_conv_tensor_rearrange.cpp

Add support for groups in Img2Col/Col2Img (#1007)

2023-10-31 10:46:32 +01:00

profile_gemm_ab_scale.cpp

[Block Scale GEMM] Optimized block scale gemm (#1950)

2025-03-11 10:11:21 -07:00

profile_gemm_add_add_fastgelu.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_add_fastgelu.cpp

Add support for mixed-precision f16bf16_int8 gemm (#1127)

2024-02-07 15:54:13 +01:00

profile_gemm_add_multiply.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_add_relu_add_layernorm.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_add_relu.cpp

Add support for mixed-precision f16bf16_int8 gemm (#1127)

2024-02-07 15:54:13 +01:00

profile_gemm_add_silu.cpp

Add support for mixed-precision f16bf16_int8 gemm (#1127)

2024-02-07 15:54:13 +01:00

profile_gemm_add.cpp

Add support for mixed-precision f16bf16_int8 gemm (#1127)

2024-02-07 15:54:13 +01:00

profile_gemm_b_scale.cpp

Implement the fp16xint4 scale weight only kernel for Ali (#1786)

2025-01-03 18:35:21 +08:00

profile_gemm_bias_add_reduce.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_bilinear.cpp

[Navi3x] Add fp16/int8 wmma conv forward instances (#746)

2023-09-07 21:59:26 -05:00

profile_gemm_fastgelu.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_multiply_add.cpp

Refactor f8_t, add bf8_t (#792)

2023-09-12 17:04:27 -05:00

profile_gemm_multiply_multiply_wp.cpp

[Block Scale GEMM] Optimized block scale gemm (#1950)

2025-03-11 10:11:21 -07:00

profile_gemm_multiply_multiply.cpp

GEMM Multiply Multiply Fix (#2102)

2025-04-22 01:13:22 -07:00

profile_gemm_reduce.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_gemm_splitk.cpp

Add an option to change the number of warm-up cycles and iterations. (#1124)

2024-01-09 09:43:08 -08:00

profile_gemm_streamk.cpp

initial stream-k implementation with example (#699)

2023-07-26 14:18:15 -05:00

profile_gemm_universal_batched.cpp

Add SplitK support into Batched GEMM V3 (#1729)

2024-12-13 21:08:35 +01:00

profile_gemm_universal_reduce.cpp

Universal gemm splitk using reduce (with multi-d) (#1341)

2024-07-19 22:01:22 +08:00

profile_gemm_universal_streamk.cpp

f8/bf16 GEMM Stream-K (#1879)

2025-03-31 20:30:17 -06:00

profile_gemm_universal.cpp

DeviceGemm_Wmma_CShuffleV3 with BlockGemmPipelineVersion::v3 (#2096)

2025-04-28 10:14:21 +05:00

profile_gemm.cpp

Fixing most of the cppcheck errors. (#1142)

2024-01-24 13:47:48 -08:00

profile_grouped_conv_bwd_data.cpp

Integrate universal gemm with conv bwd data and add SplitK (#1315)

2025-04-28 23:54:49 +02:00

profile_grouped_conv_bwd_weight.cpp

Add support for GKCYX grouped conv weight (#2023)

2025-04-02 23:59:49 +02:00

profile_grouped_conv_fwd_outelementop.cpp

Add ckProfiler support for forward 3D convolutions with OUT element-wise operations. (#1354)

2024-07-08 10:55:54 -07:00

profile_grouped_conv_fwd.cpp

Add grouped conv fwd 3d GKCYX instances for f32, f16, bf16 (#2069)

2025-04-16 11:00:55 +02:00

profile_grouped_gemm_fastgelu.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_grouped_gemm_fixed_nk.cpp

Added bf16 instances grouped gemm fixed nk (#1825)

2025-01-20 09:13:09 -08:00

profile_grouped_gemm_multiply_tile_loop.cpp

Switch to universal gemm in grouped gemm tile loop (#1335)

2024-06-18 09:01:49 -05:00

profile_grouped_gemm_tile_loop.cpp

Grouped GEMM Multiple D tile loop. (#1247)

2024-04-25 15:12:53 -05:00

profile_grouped_gemm.cpp

Polished Grouped GEMM APIs and new BF16 instances (#1600)

2024-11-27 13:02:44 +01:00

profile_groupnorm_bwd_data.cpp

layernorm and groupnorm backward data (#1083)

2023-12-19 04:23:11 +08:00

profile_groupnorm_bwd_gamma_beta.cpp

layernorm & groupnorm bwd gamma beta (#1133)

2024-01-25 19:53:15 +08:00

profile_groupnorm_fwd.cpp

layernorm and groupnorm backward data (#1083)

2023-12-19 04:23:11 +08:00

profile_layernorm_bwd_data.cpp

layernorm and groupnorm backward data (#1083)

2023-12-19 04:23:11 +08:00

profile_layernorm_bwd_gamma_beta.cpp

layernorm & groupnorm bwd gamma beta (#1133)

2024-01-25 19:53:15 +08:00

profile_layernorm_fwd.cpp

Fix F16 type (#1583)

2024-11-06 11:32:44 -08:00

profile_max_pool2d_bwd.cpp

Pool2d max/avg kernel in the BWD version (#1494)

2024-09-12 11:47:52 +02:00

profile_max_pool2d_fwd.cpp

Add pool2d int8 and fp8 instances (#1508)

2024-09-13 10:18:21 -07:00

profile_max_pool3d_bwd.cpp

MaxPool & AvgPool bwd instances, test, ckProfiler, client example (#861)

2023-08-31 21:01:50 +08:00

profile_permute_scale.cpp

Add elementwise with dynamic vector dim (#1198)

2024-03-22 10:40:43 +01:00

profile_pool3d_fwd.cpp

Extend pool3d fwd avg, max operations by f8_t, int8_t types (#1483)

2024-09-17 15:57:10 +02:00

profile_reduce.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profile_softmax.cpp

Padded Generic Kernel Instance (#730)

2023-06-16 23:43:11 -05:00

profile_transpose.cpp

Refactor elementwise kernels (#1222)

2024-04-19 13:31:17 +02:00

profiler_operation_registry.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

profiler.cpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00