mirror of
https://github.com/ROCm/composable_kernel.git
synced 2026-05-03 05:01:25 +00:00
4d041837ad
* Adding RapidJson Library * Adding Json Dumps in all CK_Tile Examples Not verified yet * Adding json to cktile Batched Transpose * adding json dumps to layernorm2d_fwd * Adding json dump to flatmm_basic * Adding RapidJson Library * Adding Json Dumps in all CK_Tile Examples Not verified yet * Adding json to cktile Batched Transpose * adding json dumps to layernorm2d_fwd * Adding json dump to flatmm_basic * Adding json in 03_gemm * Add json dump to 16_batched_gemm * Add json dump to gemm_multi_d_fp16 * Add json dump to grouped_gemm * fix fmha_bwd/fwd * Fix clang-format errors exclude include/rapidjson in jenkins as its a third-party library * Saparating function and defination. * Update Documentation of 03_gemm * Refactoring as per code review * Disable fp8 instances on unsupported targets (#2592) * Restrict building of gemm_universal_preshuffle_f8 instances to specific targets in CMakeLists.txt * Add condition to skip gemm_xdl_universal_preshuffle_f8 instances for unsupported targets in CMakeLists.txt * Add conditions to skip unsupported targets for gemm_universal_preshuffle_f8 and gemm_xdl_universal_preshuffle_f8 instances in CMakeLists.txt * Refine conditions to exclude gemm_universal_preshuffle_f8 instances for unsupported targets in CMakeLists.txt --------- Co-authored-by: AviralGoelAMD <aviralgoel@amd.com> * fix clang format * remove duplicate lines of code from library/src/tensor_operation_instance/gpu/CMakeLists.txt * Fixing Readme and unifying jsondumps * adding moe_smoothquant * adding fused_moe * Fixing Readme for batched_gemm * Fixing Readme for grouped_gemm * adding flatmm * adding gemm_multi_d_fp16 * adding elementwise * adding File name when json is dumped * Fixing Reduce after merge * adding batched_transpose * Adding Warptile in Gemm * Fixing Clang Format --------- Co-authored-by: Aviral Goel <aviral.goel@amd.com> Co-authored-by: AviralGoelAMD <aviralgoel@amd.com> Co-authored-by: illsilin_amdeng <Illia.Silin@amd.com>
43 lines
2.0 KiB
Markdown
43 lines
2.0 KiB
Markdown
# GEMM Matrix Multiplication
|
|
|
|
This folder contains example for GEMM using ck_tile tile-programming implementation. Currently, it only supports the basic feature of the CK Tile GEMM, but creates the placeholders for the future support on different GEMM pipeline and different GEMM modules. In the near future, we will gradually migrate all the GEMM features from old CK to CK Tile.
|
|
|
|
## build
|
|
```
|
|
# in the root of ck_tile
|
|
mkdir build && cd build
|
|
# you can replace <arch> with the appropriate architecture (for example gfx90a or gfx942) or leave it blank
|
|
../script/cmake-ck-dev.sh ../ <arch>
|
|
# The basic pipeline method on the gemm calculation
|
|
make tile_example_gemm_basic -j`nproc`
|
|
# The memory bound pipeline on the gemm calculation
|
|
make tile_example_gemm_universal -j`nproc`
|
|
# The weight preshuffle pipeline on the gemm calculation
|
|
make tile_example_gemm_weight_preshuffle -j`nproc`
|
|
```
|
|
This will result in an executable `build/bin/tile_example_gemm_basic` & `build/bin/tile_example_gemm_universal`
|
|
|
|
## example
|
|
```
|
|
args:
|
|
-m m dimension (default:1024)
|
|
-n n dimension (default:2048)
|
|
-k k dimension (default:64)
|
|
-a_layout Tensor A data layout (default: R)
|
|
-b_layout Tensor B data layout (default: C)
|
|
-c_layout Tensor C data layout (default: R)
|
|
-stride_a Tensor A stride (default:0)
|
|
-stride_b Tensor B stride (default:0)
|
|
-stride_c Tensor C stride (default:0)
|
|
-v 0. No validation, 1. Validation on CPU, 2. Validation on GPU (default:2)
|
|
-prec data type. fp16/bf16/fp8/bf8 (default:fp16)
|
|
-warmup number of iterations before benchmark the kernel (default:50)
|
|
-repeat number of iterations to benchmark the kernel (default:100)
|
|
-timer gpu:gpu timer, cpu:cpu timer (default:gpu)
|
|
-split_k splitK value (default:1)
|
|
-init 0:random, 1:linear, 2:constant(1) (default:0)
|
|
-persistent 0:non-persistent, 1:persistent (default:0)
|
|
-json 0: No Json, 1: Dump Results in Json format (default:0)
|
|
-jsonfile json file name to dump results (default:gemm.json)
|
|
```
|