zjing14 f9d0eddb90 Add fp16/fp8 support into Grouped gemm FixedNK (#874) ...

* move all arguments into device

* add b2c_tile_map

* add examples

* add SetDeviceKernelArgs

* dedicated fixed_nk solution

* init client api

* add grouped_gemm_bias example

* add a instance

* add instances

* formatting

* fixed cmake

* Update EnableCompilerWarnings.cmake

* Update cmake-ck-dev.sh

* clean; fixed comments

* fixed comment

* add instances for fp32 output

* add instances for fp32 output

* add fp32 out client example

* fixed CI

* init commit for kbatch

* add splitk gridwise

* format

* fixed

* clean deviceop

* clean code

* finish splitk

* fixed instances

* change m_loops to tile_loops

* add setkbatch

* clean code

* add splitK+bias

* add instances

* opt mk_nk instances

* clean examples

* fixed CI

* remove zero

* finished non-zero

* clean

* clean code

* optimized global_barrier

* fixed ci

* fixed CI

* instance and client

* removed AddBias

* format

* fixed CI

* fixed CI

* move 20_grouped_gemm to 21_grouped_gemm

* clean

* formatting

* clean

* clean

* fixed computeType

---------

Co-authored-by: Jing Zhang <jizha@amd.com>

2023-09-14 21:04:10 -05:00

..

batchnorm_multiblock

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gemm_layernorm

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

normalization

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

block_to_ctile_map.hpp

Grouped Gemm with Fixed K and N with SplitK (#818)

2023-08-31 09:22:12 -05:00

gridwise_2d_multiple_reduction_multiblock.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_2d_multiple_reduction_threadwise.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_2d_reduction_multiblock.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_2d_reduction_threadwise.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_batched_gemm_gemm_xdl_cshuffle_v1.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_batched_gemm_multiple_d_gemm_multiple_d_xdl_cshuffle_v1.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_batched_gemm_multiple_d_softmax_gemm_xdl_cshuffle_v1.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_batched_gemm_softmax_gemm_xdl_cshuffle_v1.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_batchnorm_backward_blockwise_welford.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_batchnorm_forward_blockwise_welford.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_elementwise_1d.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_elementwise_2d.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_elementwise_layernorm_welford_variance.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_gemm_bias_add_reduce_xdl_cshuffle_v1.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_dl_multiple_d.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_gemm_dl_v1r3.hpp

Redesign the DPP8 GEMM kernel to use warp-wise component (#863)

2023-09-06 11:44:09 -05:00

gridwise_gemm_dpp.hpp

Enable DPP8 GEMM on Navi3 (#892)

2023-09-08 11:14:57 -05:00

gridwise_gemm_multiple_d_multiple_r_xdl_cshuffle.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_multiple_d_wmma_cshuffle.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_multiple_d_xdl_cshuffle.hpp

Fix K padding calculation for grouped conv data (#876)

2023-09-05 10:07:41 -05:00

gridwise_gemm_multiple_d_xdl_splitk_cshuffle.hpp

Add fp16/fp8 support into Grouped gemm FixedNK (#874)

2023-09-14 21:04:10 -05:00

gridwise_gemm_pipeline_selector.hpp

Split GEMM instance library & enable pipeline v2 optimization (#783)

2023-07-06 10:59:35 -05:00

gridwise_gemm_pipeline_v1.hpp

Redesign the DPP8 GEMM kernel to use warp-wise component (#863)

2023-09-06 11:44:09 -05:00

gridwise_gemm_pipeline_v2.hpp

Split GEMM instance library & enable pipeline v2 optimization (#783)

2023-07-06 10:59:35 -05:00

gridwise_gemm_pipeline_v3.hpp

initial stream-k implementation with example (#699)

2023-07-26 14:18:15 -05:00

gridwise_gemm_reduce_xdl_cshuffle_v1.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_split_k_multiple_d_xdl_cshuffle_v2.hpp

Fp16/fp8 mixed-precision Gemm with multiply+add fusion (#865)

2023-08-28 16:27:32 -05:00

gridwise_gemm_split_k_multiple_d_xdl_cshuffle.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_waveletmodel.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_gemm_wmma.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_xdl_cshuffle_v1.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_xdl_layernorm_cshuffle_v1.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_xdl_waveletmodel_cshuffle.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_xdlops_bwd_weight.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_xdlops_skip_b_lds_v1.hpp

Enable gfx941 and gfx942 architectures. (#752)

2023-06-15 08:20:59 -07:00

gridwise_gemm_xdlops_streamk.hpp

fix gemm_streamk example on mi300 (#875)

2023-08-30 20:18:38 -07:00

gridwise_gemm_xdlops_v2r3.hpp

added padding of K into gemm_v2r3 (#887)

2023-09-06 10:15:52 -05:00

gridwise_gemm_xdlops_v2r4.hpp

Enable gfx941 and gfx942 architectures. (#752)

2023-06-15 08:20:59 -07:00

gridwise_gemm_xdlops_v2r4r2.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_xdlops_v3r1.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_xdlops_v3r2.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_gemm_xdlops_v3r3.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00

gridwise_image_to_column.hpp

Add image to column kernel (#867)

2023-09-05 10:11:40 -05:00

gridwise_permute.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_put_element_1d.hpp

Average pool backward deviceOP and example (#797)

2023-08-10 12:04:35 +08:00

gridwise_set_buffer_value.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_set_multiple_buffer_value.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_softmax.hpp

update copyright headers (#726)

2023-05-31 18:46:57 -05:00

gridwise_sparse_embeddings_forward_layernorm.hpp

[HotFix] add config and version files to pass on build info (#856)

2023-08-23 11:36:17 -07:00