Dan Yao 2cab8d39e3 CK Tile FA Training kernels (#1286) ...

* FA fwd dropout

* FA bwd

* epilogue reuse

* CMakeLists update

* [CK_TILE] support alibi (#1269)

* add alibi support

* fix code

* update code based on comment

* Support more hdim

* fix fp8 bias

* support seqlen_k=0 case

* remove unused printf

* fix format

---------

Co-authored-by: rocking <ChunYu.Lai@amd.com>

* now fwd/bwd can build

* bwd alibi

* add bwd validation stream_config

* update generated filenames

* update bwd kernel launch

* CK_TILE_HOST_DEVICE in philox

* Transpose -> transpose

* format

* format

* format

* Generate the instance for FA required

* format

* fix error in WarpGemm

---------

Co-authored-by: danyao12 <danyao12>
Co-authored-by: carlushuang <carlus.huang@amd.com>
Co-authored-by: rocking <ChunYu.Lai@amd.com>
Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>
Co-authored-by: Jing Zhang <jizhan@amd.com>

2024-06-04 13:12:45 -05:00

..

benchmark_bwd.sh

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

benchmark_fwd.sh

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

smoke_test_bwd.sh

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

smoke_test_fwd.sh

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00