bibek e0ef2ba864 adding mha as static lib (#1366) ...

* adding mha as static lib

* add fmha fwd compile options

* typo

* fix python version

* python version to 3

* increase path length

* add max path flag in mha cmake

* fix long path issue

* mha currently only runs in gfx94x

* only buld mha in mi300

* populate gpu_list

* add mha compile flags

* avoid building mha in gpu other then gfx94x

* some comments and  include ck_tile in rocm

* use rocm_install

* place ck_tile in include

* correct ck_tile path

---------

Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com>

[ROCm/composable_kernel commit: 840c5397bb]

2024-08-06 11:17:10 -05:00

..

avg_pool3d_bwd

Refactoring cmake files to build data types separately. (#932)

2023-09-20 22:15:56 -07:00

batched_gemm

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_add_relu_gemm_add

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_bias_permute

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_gemm

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_multi_d

Refactoring cmake files to build data types separately. (#932)

2023-09-20 22:15:56 -07:00

batched_gemm_reduce

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_softmax_gemm

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batched_gemm_softmax_gemm_permute

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

batchnorm

Refactor elementwise kernels (#1222)

2024-04-19 13:31:17 +02:00

column_to_image

Add support for groups in Img2Col/Col2Img (#1007)

2023-10-31 10:46:32 +01:00

contraction_bilinear

Extend support for contraction 6D (#1207)

2024-04-09 23:46:21 +02:00

contraction_scale

Extend support for contraction 6D (#1207)

2024-04-09 23:46:21 +02:00

conv1d_bwd_data

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

conv2d_bwd_data

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

conv2d_fwd

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

conv2d_fwd_bias_relu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

conv2d_fwd_bias_relu_add

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

conv3d_bwd_data

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

elementwise

Refactor elementwise kernels (#1222)

2024-04-19 13:31:17 +02:00

elementwise_normalization

Refactoring cmake files to build data types separately. (#932)

2023-09-20 22:15:56 -07:00

gemm

Navi3 rel (#1176)

2024-03-08 17:11:51 -08:00

gemm_ab_scale

[GEMM] F8 GEMM, performance optimized. (#1384)

2024-07-19 22:06:52 +08:00

gemm_add

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_add_fastgelu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_fastgelu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_multiply

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_relu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_relu_add_layernorm

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_add_silu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_bias_add_reduce

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_bilinear

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_fastgelu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_multi_abd

Split the gemm_multi_abd instances. (#1306)

2024-05-23 09:17:02 -07:00

gemm_multiply_add

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_multiply_multiply

[GEMM] F8 GEMM, performance optimized. (#1384)

2024-07-19 22:06:52 +08:00

gemm_reduce

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_splitk

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_streamk

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

gemm_universal

disable bad instance (#1410)

2024-07-23 09:05:03 -07:00

gemm_universal_reduce

Universal gemm splitk using reduce (with multi-d) (#1341)

2024-07-19 22:01:22 +08:00

gemm_universal_streamk

Universal streamk with atomics (#1360)

2024-07-05 21:40:30 -07:00

grouped_conv1d_bwd_weight

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv1d_fwd

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv2d_bwd_data

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv2d_bwd_weight

Optimize grouped conv bwd weight for small M and N (#1303)

2024-05-22 21:01:01 +02:00

grouped_conv2d_fwd

Add Grouped Conv Fwd Large Tensor kernel (#1432)

2024-08-06 10:06:10 +02:00

grouped_conv3d_bwd_data

Add an ignore (#1270)

2024-04-30 20:45:22 -07:00

grouped_conv3d_bwd_data_bilinear

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv3d_bwd_data_scale

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv3d_bwd_weight

Optimize grouped conv bwd weight for small M and N (#1303)

2024-05-22 21:01:01 +02:00

grouped_conv3d_bwd_weight_bilinear

Add grouped conv bwd weight multi d kernel (#1237)

2024-04-18 23:35:04 +02:00

grouped_conv3d_bwd_weight_scale

Add grouped conv bwd weight multi d kernel (#1237)

2024-04-18 23:35:04 +02:00

grouped_conv3d_fwd

Add Grouped Conv Fwd Large Tensor kernel (#1432)

2024-08-06 10:06:10 +02:00

grouped_conv3d_fwd_bilinear

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv3d_fwd_convinvscale

Add a convinvscale op, related instances and examples (#1307)

2024-06-10 14:48:49 -05:00

grouped_conv3d_fwd_convscale

Add instances for grouped conv fwd 3d with ConvScale for bf8@fp8->fp8 (#1369)

2024-07-11 13:31:39 -07:00

grouped_conv3d_fwd_convscale_add

Adding more instances of grouped convolution 3d forward for FP8 with ConvScale+Bias element-wise operation. (#1412)

2024-07-24 15:49:55 -05:00

grouped_conv3d_fwd_convscale_relu

Adding more instances of grouped convolution 3d forward for FP8 with ConvScale element-wise operation and ReLU activation. (#1386)

2024-07-16 08:51:49 -07:00

grouped_conv3d_fwd_scale

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv3d_fwd_scaleadd_ab

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_conv3d_fwd_scaleadd_scaleadd_relu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_gemm

Add bf16 and bf16@int8 mk_nk_mn instances for grouped gemm two stage (#1228)

2024-04-19 13:16:10 +02:00

grouped_gemm_bias

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_gemm_fastgelu

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_gemm_fixed_nk

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

grouped_gemm_fixed_nk_multi_abd

bf16A_Int8B with fastgelu/bias (#1264)

2024-04-26 07:26:30 -05:00

grouped_gemm_tile_loop

Switch to universal gemm in grouped gemm tile loop (#1335)

2024-06-18 09:01:49 -05:00

image_to_column

Add support for groups in Img2Col/Col2Img (#1007)

2023-10-31 10:46:32 +01:00

max_pool_bwd

Refactoring cmake files to build data types separately. (#932)

2023-09-20 22:15:56 -07:00

mha

adding mha as static lib (#1366)

2024-08-06 11:17:10 -05:00

normalization_bwd_data

layernorm and groupnorm backward data (#1083)

2023-12-19 04:23:11 +08:00

normalization_bwd_gamma_beta

layernorm & groupnorm bwd gamma beta (#1133)

2024-01-25 19:53:15 +08:00

normalization_fwd

layernorm and groupnorm backward data (#1083)

2023-12-19 04:23:11 +08:00

permute_scale

Add elementwise with dynamic vector dim (#1198)

2024-03-22 10:40:43 +01:00

pool3d_fwd

Refactoring cmake files to build data types separately. (#932)

2023-09-20 22:15:56 -07:00

quantization

Split the instances by architecture. (#1223)

2024-04-02 09:42:17 -07:00

reduce

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

softmax

enable compilation of INSTANCES_ONLY for Windows (#1082)

2023-12-20 14:34:53 -08:00

transpose

Hip tensor permute unit test (#1068)

2023-12-18 21:35:00 -06:00

CMakeLists.txt

adding mha as static lib (#1366)

2024-08-06 11:17:10 -05:00