Haocong WANG be31f1ddf3 [GEMM] F8 GEMM, performance optimized. (#1384) ...

* add ab_scale init support

* enabled interwave

* add scale type; update isSupport

* adjust example

* clean

* enable f8 pure gemm rcr ckprofiler

* Add gemm_multiply_multiply instances

* clang format

* Optimize for ScaleBlockMNK=128

* enable abscale f8 gemm ck profiler

* Add pure f8 gemm test suite

* Reverting to the state of project at f60fd77

* update copyright

* clang format

* update copyright

---------

Co-authored-by: root <jizhan@amd.com>

[ROCm/composable_kernel commit: 8c90f25be3]

2024-07-19 22:06:52 +08:00

..

blockwise_gemm_dl_v2r3.hpp

Implement DPP8 based GEMM for Navi21 (#826)

2023-08-14 15:46:27 -05:00

blockwise_gemm_dlops_v2r2.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

blockwise_gemm_dlops_v3.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

blockwise_gemm_dpp.hpp

Fix cmake warnings (#1342)

2024-06-21 09:47:58 +02:00

blockwise_gemm_pipeline_xdlops_ab_scale_selector.hpp

[GEMM] F8 GEMM, performance optimized. (#1384)

2024-07-19 22:06:52 +08:00

blockwise_gemm_pipeline_xdlops_base.hpp

[GEMM] Gemm universal device operation (#1154)

2024-04-13 21:03:18 -05:00

blockwise_gemm_pipeline_xdlops_selector.hpp

[GEMM] Gemm universal device operation (#1154)

2024-04-13 21:03:18 -05:00

blockwise_gemm_pipeline_xdlops_v1_ab_scale.hpp

[GEMM] F8 GEMM, performance optimized. (#1384)

2024-07-19 22:06:52 +08:00

blockwise_gemm_pipeline_xdlops_v1.hpp

Fix cmake warnings (#1342)

2024-06-21 09:47:58 +02:00

blockwise_gemm_pipeline_xdlops_v2_ab_scale.hpp

[GEMM] F8 GEMM, performance optimized. (#1384)

2024-07-19 22:06:52 +08:00

blockwise_gemm_pipeline_xdlops_v2.hpp

Fix cmake warnings (#1342)

2024-06-21 09:47:58 +02:00

blockwise_gemm_pipeline_xdlops_v3_ab_scale.hpp

[GEMM] F8 GEMM, performance optimized. (#1384)

2024-07-19 22:06:52 +08:00

blockwise_gemm_pipeline_xdlops_v3.hpp

Fix cmake warnings (#1342)

2024-06-21 09:47:58 +02:00

blockwise_gemm_pipeline_xdlops_v4.hpp

Fix cmake warnings (#1342)

2024-06-21 09:47:58 +02:00

blockwise_gemm_pipeline_xdlops_v5.hpp

Fix cmake warnings (#1342)

2024-06-21 09:47:58 +02:00

blockwise_gemm_pipeline_xdlops.hpp

Fix cmake warnings (#1342)

2024-06-21 09:47:58 +02:00

blockwise_gemm_wmma.hpp

Merging the gfx12 code into public repo. (#1362)

2024-06-27 00:33:34 -07:00

blockwise_gemm_xdlops_skip_b_lds.hpp

Fix cmake warnings (#1342)

2024-06-21 09:47:58 +02:00

blockwise_gemm_xdlops.hpp

Merging the gfx12 code into public repo. (#1362)

2024-06-27 00:33:34 -07:00

blockwise_softmax.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

blockwise_tensor_slice_transfer_v5r1.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

blockwise_welford.hpp

Batchnorm splitk single kernel (#771)

2023-07-06 10:58:55 -05:00

reduction_functions_blockwise.hpp

Batchnorm splitk single kernel (#771)

2023-07-06 10:58:55 -05:00

thread_group_tensor_slice_transfer_direct_load.hpp

Add basic support for direct loads from global to LDS (#999)

2023-11-25 13:35:22 +01:00

thread_group_tensor_slice_transfer_v4r1_dequant.hpp

Navi3 rel (#1176)

2024-03-08 17:11:51 -08:00

thread_group_tensor_slice_transfer_v4r1.hpp

initial stream-k implementation with example (#699)

2023-07-26 14:18:15 -05:00

thread_group_tensor_slice_transfer_v4r2.hpp

Add elementwise with dynamic vector dim (#1198)

2024-03-22 10:40:43 +01:00

thread_group_tensor_slice_transfer_v6r1.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

thread_group_tensor_slice_transfer_v6r1r2.hpp

initial stream-k implementation with example (#699)

2023-07-26 14:18:15 -05:00

thread_group_tensor_slice_transfer_v6r2.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

thread_group_tensor_slice_transfer_v6r3.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

thread_group_tensor_slice_transfer_v7.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

thread_group_tensor_slice_transfer_v7r2.hpp

bf16A_Int8B with fastgelu/bias (#1264)

2024-04-26 07:26:30 -05:00

thread_group_tensor_slice_transfer_v7r3.hpp

add f8 gemm multiD with both row/col wise scale (#1300)

2024-05-28 12:04:22 -05:00