mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-03 05:01:25 +00:00

Files

Adam Osewski 24d996aae1 [CK-Tile] Universal gemm memory bound pipeline (#1558 )

* CK-Tile GEMM with memory bound pipeline.

* Memory bound gemm pipeline.

* Fix not closed namespace.

* Block gemm mem pipeline draft.

* Do not use ck_tile:: within ck_tile namespace.

* Refactoring & Move Layout info to pipeline problem.

* Get hot loop and TailNum information before lunching kernel.

* Fixes in pipeline.

* Add comment to load_tile_raw and change variable naming style.

* Few small changes & formatting.

* Do not use macro.

* Add gtests.

* Use AccDataType for Output of MFMA instruction.

* Formatting.

* Refactor gemm examples.

* Switch over to current block gemm.

* Use currently available pipeline policy.

* Refactoring and review comment.s

* Fixes after merge.

* Add missing include.

* Add load tile overload which accepts output tensor as parameter.

* This give 8% perf boost at the cost of using more registers.

* Rename example.

* Small changes.

* Fix compilation err and lower K.

* Support different layouts for A/B

* Fix vector size for different layouts.

* Rename Alignment into VectorSize

* Unblock tests.

2024-10-30 10:05:15 +01:00

script

Ck tile GPU verification sample develop & Add the CK TILE GEMM to the CI/CD test (#1505 )

2024-09-14 21:08:40 +08:00

CMakeLists.txt

[CK-Tile] Universal gemm memory bound pipeline (#1558 )

2024-10-30 10:05:15 +01:00

gemm_basic.cpp

[CK-Tile] Universal gemm memory bound pipeline (#1558 )

2024-10-30 10:05:15 +01:00

gemm_basic.hpp

[CK-Tile] Universal gemm memory bound pipeline (#1558 )

2024-10-30 10:05:15 +01:00

gemm_mem_pipeline.cpp

[CK-Tile] Universal gemm memory bound pipeline (#1558 )

2024-10-30 10:05:15 +01:00

README.md

[CK_TILE] Update example README files & fix script compatibility issue (#1548 )

2024-10-08 10:45:12 +08:00

run_gemm_example.inc

[CK-Tile] Universal gemm memory bound pipeline (#1558 )

2024-10-30 10:05:15 +01:00

README.md

GEMM Matrix Multiplication

This folder contains example for GEMM using ck_tile tile-programming implementation. Currently, it only supports the basic feature of the CK Tile GEMM, but creates the placeholders for the future support on different GEMM pipeline and different GEMM modules. In the near future, we will gradually migrate all the GEMM features from old CK to CK Tile.

build

# in the root of ck_tile
mkdir build && cd build
# you can replace <arch> with the appropriate architecture (for example gfx90a or gfx942) or leave it blank
sh ../script/cmake-ck-dev.sh  ../ <arch>
make tile_example_gemm_basic -j

This will result in an executable build/bin/tile_example_gemm_basic

example

args:
          -b    batch size (default:1)
          -m    m dimension (default:1024)
          -n    n dimension (default:2048)
          -k    k dimension (default:64)
   -stride_a    Tensor A stride (default:0)
   -stride_b    Tensor B stride (default:0)
   -stride_c    Tensor C stride (default:0)
          -v    0. No validation, 1. Validation on CPU, 2. Validation on GPU (default:2)
          -e    Absolute error tolerance (default:1e-5)
       -prec    data type. fp16/bf16/fp8/bf8 (default:fp16)
     -warmup    number of iterations before benchmark the kernel (default:10)
     -repeat    number of iterations to benchmark the kernel (default:100)
      -timer    gpu:gpu timer, cpu:cpu timer (default:gpu)