mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-04 13:41:24 +00:00

Files

Dan Yao 2cab8d39e3 CK Tile FA Training kernels (#1286 )

* FA fwd dropout

* FA bwd

* epilogue reuse

* CMakeLists update

* [CK_TILE] support alibi (#1269)

* add alibi support

* fix code

* update code based on comment

* Support more hdim

* fix fp8 bias

* support seqlen_k=0 case

* remove unused printf

* fix format

---------

Co-authored-by: rocking <ChunYu.Lai@amd.com>

* now fwd/bwd can build

* bwd alibi

* add bwd validation stream_config

* update generated filenames

* update bwd kernel launch

* CK_TILE_HOST_DEVICE in philox

* Transpose -> transpose

* format

* format

* format

* Generate the instance for FA required

* format

* fix error in WarpGemm

---------

Co-authored-by: danyao12 <danyao12>
Co-authored-by: carlushuang <carlus.huang@amd.com>
Co-authored-by: rocking <ChunYu.Lai@amd.com>
Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>
Co-authored-by: Jing Zhang <jizhan@amd.com>

2024-06-04 13:12:45 -05:00

algorithm

introducing ck_tile! (#1216 )

2024-04-15 19:27:12 -05:00

arch

CK Tile FA Training kernels (#1286 )

2024-06-04 13:12:45 -05:00

container

introducing ck_tile! (#1216 )

2024-04-15 19:27:12 -05:00

numeric

CK Tile FA Training kernels (#1286 )

2024-06-04 13:12:45 -05:00

tensor

CK Tile FA Training kernels (#1286 )

2024-06-04 13:12:45 -05:00

utility

CK Tile FA Training kernels (#1286 )

2024-06-04 13:12:45 -05:00

config.hpp

[CK_TILE] support group from cmdline (#1295 )

2024-05-28 11:13:21 +08:00

README.md

introducing ck_tile! (#1216 )

2024-04-15 19:27:12 -05:00

README.md

ck_tile/core

ck_tile/core contains every basic functions and structures to create a GPU kernel using ck_tile. User should only include ck_tile/core.hpp this single header to use all the functionality. Everything is under ck_tile namespace. The coding style under this folder should be similar to std (snake_case for structure/function, Camel for template types...)

algorithm/
    coordinate transform and some other reusable algorithm
arch/
    contains some basic device building block like mma, buffer addressing, etc...
container/
    contains basic container data structure, array/sequence/tuple/...
numeric/
    data type, and data type related math
tensor/
    tensor descriptors and tile level API
utility/
    other utility function for both host/device