feli 1f484facd3 Dev/merge u8w8 (#1774) ...

* port tiles from a8w8

* rm debug used files

* add instances

* remove all non gemm in cmake

* merge; impl fp16

* recover cmake from develop

* add missed files; fix clang format

---------

Co-authored-by: coderfeli <coderfeli@163.com>

[ROCm/composable_kernel commit: 53ab1b9047]

2025-01-13 10:25:14 -08:00

..

avg_pool2d_bwd

Pool2d max/avg kernel in the BWD version (#1494)

2024-09-12 11:47:52 +02:00

avg_pool3d_bwd

Refactoring cmake files to build data types separately. (#932)

2023-09-20 22:15:56 -07:00

batched_gemm

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_add_relu_gemm_add

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_bias_permute

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_gemm

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_multi_d

Refactoring cmake files to build data types separately. (#932)

2023-09-20 22:15:56 -07:00

batched_gemm_reduce

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_softmax_gemm

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_softmax_gemm_permute

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batchnorm

Refactor elementwise kernels (#1222)

2024-04-19 13:31:17 +02:00

column_to_image

Add support for groups in Img2Col/Col2Img (#1007)

2023-10-31 10:46:32 +01:00

contraction_bilinear

Extend support for contraction 6D (#1207)

2024-04-09 23:46:21 +02:00

contraction_scale

Extend support for contraction 6D (#1207)

2024-04-09 23:46:21 +02:00

conv1d_bwd_data

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

conv2d_bwd_data

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

conv2d_fwd

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

conv2d_fwd_bias_relu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

conv2d_fwd_bias_relu_add

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

conv3d_bwd_data

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

elementwise

Refactor elementwise kernels (#1222)

2024-04-19 13:31:17 +02:00

elementwise_normalization

Refactoring cmake files to build data types separately. (#932)

2023-09-20 22:15:56 -07:00

gemm

add more fp32 dl gemm instances (#1675)

2024-11-19 10:00:17 -08:00

gemm_ab_scale

[GEMM] gemm_universal related optimization (#1453)

2024-08-14 10:42:30 +08:00

gemm_add

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_add_fastgelu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_fastgelu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_multiply

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_relu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_relu_add_layernorm

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_silu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_b_scale

Implement the fp16xint4 scale weight only kernel for Ali (#1786)

2025-01-03 18:35:21 +08:00

gemm_bias_add_reduce

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_bilinear

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_fastgelu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_multi_abd

Split the gemm_multi_abd instances. (#1306)

2024-05-23 09:17:02 -07:00

gemm_multiply_add

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_multiply_multiply

Dev/merge u8w8 (#1774)

2025-01-13 10:25:14 -08:00

gemm_reduce

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_splitk

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_streamk

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_universal

Jing's contribution: prototype of mixed precision gemm FP16/BF16xint4 GEMM (#1762)

2025-01-02 11:48:06 +08:00

gemm_universal_batched

Add SplitK support into Batched GEMM V3 (#1729)

2024-12-13 21:08:35 +01:00

gemm_universal_reduce

Universal gemm splitk using reduce (with multi-d) (#1341)

2024-07-19 22:01:22 +08:00

gemm_universal_streamk

BF16 GEMM Stream-K (#1541)

2025-01-02 10:30:04 -08:00

grouped_conv1d_bwd_weight

Enable grouped conv bwd wei bf16 NGCHW (#1589)

2024-10-22 16:18:28 +02:00

grouped_conv1d_fwd

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv2d_bwd_data

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv2d_bwd_weight

Grouped convolution backward weight special vector size loads (#1772)

2025-01-10 22:02:30 +08:00

grouped_conv2d_fwd

Add NGCHW bf16 grouped conv fwd instances (#1783)

2025-01-01 18:00:06 +01:00

grouped_conv2d_fwd_dynamic_op

Temporary disable part of dynamic op conv instances (#1630)

2024-11-04 13:34:17 -08:00

grouped_conv3d_bwd_data

Re-enable fp8 types for all architectures. (#1470)

2024-08-16 16:07:52 -06:00

grouped_conv3d_bwd_data_bilinear

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv3d_bwd_data_scale

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv3d_bwd_weight

Grouped convolution backward weight special vector size loads (#1772)

2025-01-10 22:02:30 +08:00

grouped_conv3d_bwd_weight_bilinear

Re-enable fp8 types for all architectures. (#1470)

2024-08-16 16:07:52 -06:00

grouped_conv3d_bwd_weight_scale

Re-enable fp8 types for all architectures. (#1470)

2024-08-16 16:07:52 -06:00

grouped_conv3d_fwd

Revert "Revert "Revert Revert Support access per groups and filter2x3 in grouped conv fwd (#1382) (#1406) (#1415)" (#1455)" (#1490)

2024-09-02 10:39:49 +02:00

grouped_conv3d_fwd_bilinear

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv3d_fwd_convinvscale

Add a convinvscale op, related instances and examples (#1307)

2024-06-10 14:48:49 -05:00

grouped_conv3d_fwd_convscale

Adding Instances and Examples for FP8-based Scaled Convolution and AMAX Reduction. (#1473)

2024-08-21 15:22:41 -07:00

grouped_conv3d_fwd_convscale_add

Adding more instances of grouped convolution 3d forward for FP8 with ConvScale+Bias element-wise operation. (#1412)

2024-07-24 15:49:55 -05:00

grouped_conv3d_fwd_convscale_relu

Adding Instances and Examples for FP8-based Scaled Convolution and AMAX Reduction. (#1473)

2024-08-21 15:22:41 -07:00

grouped_conv3d_fwd_dynamic_op

Temporary disable part of dynamic op conv instances (#1630)

2024-11-04 13:34:17 -08:00

grouped_conv3d_fwd_scale

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv3d_fwd_scaleadd_ab

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv3d_fwd_scaleadd_scaleadd_relu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_gemm

Polished Grouped GEMM APIs and new BF16 instances (#1600)

2024-11-27 13:02:44 +01:00

grouped_gemm_bias

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_gemm_fastgelu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_gemm_fixed_nk

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_gemm_fixed_nk_multi_abd

bf16A_Int8B with fastgelu/bias (#1264)

2024-04-26 07:26:30 -05:00

grouped_gemm_tile_loop

Polished Grouped GEMM APIs and new BF16 instances (#1600)

2024-11-27 13:02:44 +01:00

image_to_column

Add support for groups in Img2Col/Col2Img (#1007)

2023-10-31 10:46:32 +01:00

max_pool_bwd

This commit contains implementation of max pool2d for f8 type (#1506)

2024-09-16 10:15:06 +02:00

mha

Refactor CI performance tests. (#1726)

2024-12-06 13:04:25 -08:00

normalization_bwd_data

layernorm and groupnorm backward data (#1083)

2023-12-19 04:23:11 +08:00

normalization_bwd_gamma_beta

layernorm & groupnorm bwd gamma beta (#1133)

2024-01-25 19:53:15 +08:00

normalization_fwd

layernorm and groupnorm backward data (#1083)

2023-12-19 04:23:11 +08:00

permute_scale

Adding Instances and Examples for FP8-based Scaled Convolution with ReLU Activation and AMAX Reduction. (#1469)

2024-08-20 10:30:56 -05:00

pool2d_fwd

Add pool2d int8 and fp8 instances (#1508)

2024-09-13 10:18:21 -07:00

pool3d_fwd

OCP FP8 support for gfx12. (#1710)

2024-12-03 08:42:55 -08:00

quantization

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

reduce

Adding Instances and Examples for FP8-based Scaled Convolution with ReLU Activation and AMAX Reduction. (#1469)

2024-08-20 10:30:56 -05:00

softmax

enable compilation of INSTANCES_ONLY for Windows (#1082)

2023-12-20 14:34:53 -08:00

transpose

Hip tensor permute unit test (#1068)

2023-12-18 21:35:00 -06:00

CMakeLists.txt

Disable building DPP kernels by default (#1804)

2025-01-08 13:50:42 -05:00