Thomas Ning 2315555bc5 Add the instances for small sized GEMM in preshuffle and improve CMake Flag (#2212) ...

* Add small instance, add the bug fix, & improve the example CMake

* clang format

[ROCm/composable_kernel commit: 1386924749]

2025-05-20 15:05:08 -07:00

..

blockwise_gemm_dl_v2r3.hpp

…

blockwise_gemm_dlops_v2r2.hpp

…

blockwise_gemm_dlops_v3.hpp

…

blockwise_gemm_dpp.hpp

…

blockwise_gemm_mx_pipeline_xdlops_base.hpp

MX GEMM - New GEMM pipeline for MX data types (#2059)

2025-04-15 17:17:07 -06:00

blockwise_gemm_pipeline_wmma_selector.hpp

DeviceGemm_Wmma_CShuffleV3 with BlockGemmPipelineVersion::v3 (#2096)

2025-04-28 10:14:21 +05:00

blockwise_gemm_pipeline_wmmaops_base.hpp

DeviceGemm_Wmma_CShuffleV3 with BlockGemmPipelineVersion::v3 (#2096)

2025-04-28 10:14:21 +05:00

blockwise_gemm_pipeline_wmmaops_v3.hpp

DeviceGemm_Wmma_CShuffleV3 with BlockGemmPipelineVersion::v3 (#2096)

2025-04-28 10:14:21 +05:00

blockwise_gemm_pipeline_wmmaops.hpp

DeviceGemm_Wmma_CShuffleV3 with BlockGemmPipelineVersion::v3 (#2096)

2025-04-28 10:14:21 +05:00

blockwise_gemm_pipeline_xdlops_ab_scale_selector.hpp

[A8W8 GEMM] Optimized weight-preshuffled implementation & add quantization datatype for CK TILE rms_norm (#1862)

2025-02-20 14:00:27 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_dequant_v1.hpp

Ck int4 moe develop (#1949)

2025-03-10 11:16:44 +08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_dequant_v3.hpp

Use new mfma instructions for FP8 on gfx950 (#2202)

2025-05-19 17:29:51 -07:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_gufusion_dequant_v1.hpp

Moe gemm activation (#2026)

2025-04-23 10:35:34 +08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_gufusion_v1.hpp

Moe gemm activation (#2026)

2025-04-23 10:35:34 +08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_selector.hpp

Moe gemm activation (#2026)

2025-04-23 10:35:34 +08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_v1.hpp

Improve the general performance of the Preshuffled GEMM V3 & delete the unnecessary instances (#2166)

2025-05-12 09:52:58 -07:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_v2.hpp

Add the instances for small sized GEMM in preshuffle and improve CMake Flag (#2212)

2025-05-20 15:05:08 -07:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_v3.hpp

Narrowing error fix for codegen compilation (#2194)

2025-05-16 11:11:54 -07:00

blockwise_gemm_pipeline_xdlops_b_scale_selector.hpp

[A8W8 GEMM] Optimized weight-preshuffled implementation & add quantization datatype for CK TILE rms_norm (#1862)

2025-02-20 14:00:27 -08:00

blockwise_gemm_pipeline_xdlops_base.hpp

Improve the general performance of the Preshuffled GEMM V3 & delete the unnecessary instances (#2166)

2025-05-12 09:52:58 -07:00

blockwise_gemm_pipeline_xdlops_mx_selector.hpp

MX GEMM - New GEMM pipeline for MX data types (#2059)

2025-04-15 17:17:07 -06:00

blockwise_gemm_pipeline_xdlops_selector.hpp

[A8W8 GEMM] Optimized weight-preshuffled implementation & add quantization datatype for CK TILE rms_norm (#1862)

2025-02-20 14:00:27 -08:00

blockwise_gemm_pipeline_xdlops_v1_ab_scale.hpp

[Block Scale GEMM] Optimized block scale gemm (#1950)

2025-03-11 10:11:21 -07:00

blockwise_gemm_pipeline_xdlops_v1_b_scale.hpp

Implement the fp16xint4 scale weight only kernel for Ali (#1786)

2025-01-03 18:35:21 +08:00

blockwise_gemm_pipeline_xdlops_v1_mx.hpp

MX GEMM - New GEMM pipeline for MX data types (#2059)

2025-04-15 17:17:07 -06:00

blockwise_gemm_pipeline_xdlops_v1.hpp

…

blockwise_gemm_pipeline_xdlops_v2_ab_scale.hpp

[Block Scale GEMM] Optimized block scale gemm (#1950)

2025-03-11 10:11:21 -07:00

blockwise_gemm_pipeline_xdlops_v2_b_scale.hpp

Implement the fp16xint4 scale weight only kernel for Ali (#1786)

2025-01-03 18:35:21 +08:00

blockwise_gemm_pipeline_xdlops_v2.hpp

Change block gemm pipeline local prefill loop order. (#1692)

2024-11-26 17:36:53 +01:00

blockwise_gemm_pipeline_xdlops_v3_ab_scale.hpp

[Block Scale GEMM] Optimized block scale gemm (#1950)

2025-03-11 10:11:21 -07:00

blockwise_gemm_pipeline_xdlops_v3_b_scale.hpp

Implement the fp16xint4 scale weight only kernel for Ali (#1786)

2025-01-03 18:35:21 +08:00

blockwise_gemm_pipeline_xdlops_v3.hpp

…

blockwise_gemm_pipeline_xdlops_v4_b_scale.hpp

Implement the fp16xint4 scale weight only kernel for Ali (#1786)

2025-01-03 18:35:21 +08:00

blockwise_gemm_pipeline_xdlops_v4.hpp

[A8W8 GEMM] Optimized weight-preshuffled implementation & add quantization datatype for CK TILE rms_norm (#1862)

2025-02-20 14:00:27 -08:00

blockwise_gemm_pipeline_xdlops_v5.hpp

…

blockwise_gemm_pipeline_xdlops.hpp

Fix compilation errors with Clang20.0. (#1533)

2024-09-25 13:45:38 -07:00

blockwise_gemm_smfmac_xdlops.hpp

…

blockwise_gemm_wmma.hpp

fix compilation errors for gfx12 with clang20 (#1606)

2024-10-28 19:02:48 -07:00

blockwise_gemm_xdlops_skip_b_lds.hpp

…

blockwise_gemm_xdlops.hpp

…

blockwise_softmax.hpp

…

blockwise_tensor_slice_transfer_v5r1.hpp

…

blockwise_welford.hpp

…

reduction_functions_blockwise.hpp

…

thread_group_tensor_slice_transfer_direct_load.hpp

…

thread_group_tensor_slice_transfer_v4r1_dequant.hpp

…

thread_group_tensor_slice_transfer_v4r1_gather.hpp

Moe gemm activation (#2026)

2025-04-23 10:35:34 +08:00

thread_group_tensor_slice_transfer_v4r1.hpp

[A8W8 GEMM] Optimized weight-preshuffled implementation & add quantization datatype for CK TILE rms_norm (#1862)

2025-02-20 14:00:27 -08:00

thread_group_tensor_slice_transfer_v4r2.hpp

…

thread_group_tensor_slice_transfer_v6r1.hpp

…

thread_group_tensor_slice_transfer_v6r1r2.hpp

…

thread_group_tensor_slice_transfer_v6r2.hpp

…

thread_group_tensor_slice_transfer_v6r3.hpp

…

thread_group_tensor_slice_transfer_v7.hpp

…

thread_group_tensor_slice_transfer_v7r2.hpp

Codegen hipRTC compilation (#1579)

2025-01-31 09:48:39 -08:00

thread_group_tensor_slice_transfer_v7r3_scatter.hpp

Moe gemm activation (#2026)

2025-04-23 10:35:34 +08:00

thread_group_tensor_slice_transfer_v7r3.hpp

…