Adam Osewski b6bcd76d88 CK-Tile first draft of universal block gemm with interwave & intrawave scheduler (#1676) ...

* Block universal gemm.

* Universal block gemm with interwave scheduler - draft.

* Refactoring

* Move a/b_warp_tiles into BlockGemmImpl
* set BlockGemmImpl as a class member

* Change tile size for more suitable to memory bound cases.

* Introduce kKPerThread to WarpGemm

* Add documentation comment.

* Fix Interwave scheduler block gemm.

* Add compute/memory friendly tile configuration.

* Clean

* New tile configurations in gemm mem example.

* Add more static checks and fix loop order in block gemm.

* Add more static checks and use warp gemm mfma dispatcher.

* Add default scheduler block gemm.

* Remove logging in example.

2024-11-26 08:45:14 +01:00

..

block_gemm_areg_bgmem_creg_v1_default_policy.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

block_gemm_areg_bgmem_creg_v1.hpp

[CK-Tile] Universal gemm memory bound pipeline (#1558)

2024-10-30 10:05:15 +01:00

block_gemm_areg_breg_creg_v1_custom_policy.hpp

[CK_TILE] FA bwd kernels optimization (#1397)

2024-08-16 13:40:10 -07:00

block_gemm_areg_breg_creg_v1_default_policy.hpp

[CK_TILE] FA bwd kernels optimization (#1397)

2024-08-16 13:40:10 -07:00

block_gemm_areg_breg_creg_v1.hpp

[CK_TILE] More fmha splitkv optimizations (#1588)

2024-10-26 18:35:45 +08:00

block_gemm_areg_bsmem_creg_one_warp_v1.hpp

[CK_TILE] More fmha splitkv optimizations (#1588)

2024-10-26 18:35:45 +08:00

block_gemm_areg_bsmem_creg_v1_custom_policy.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

block_gemm_areg_bsmem_creg_v1_default_policy.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

block_gemm_areg_bsmem_creg_v1.hpp

[CK_TILE] More fmha splitkv optimizations (#1588)

2024-10-26 18:35:45 +08:00

block_gemm_areg_bsmem_creg_v2_custom_policy.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

block_gemm_areg_bsmem_creg_v2_default_policy.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

block_gemm_areg_bsmem_creg_v2.hpp

[CK_TILE] More fmha splitkv optimizations (#1588)

2024-10-26 18:35:45 +08:00

block_gemm_asmem_breg_creg_v1_custom_policy.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

block_gemm_asmem_breg_creg_v1_default_policy.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

block_gemm_asmem_breg_creg_v1.hpp

[CK_TILE] More fmha splitkv optimizations (#1588)

2024-10-26 18:35:45 +08:00

block_gemm_asmem_bsmem_creg_v1_custom_policy.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

block_gemm_asmem_bsmem_creg_v1_default_policy.hpp

Ck tile gemm example (#1488)

2024-09-07 16:23:32 +08:00

block_gemm_asmem_bsmem_creg_v1.hpp

[CK-Tile] Universal gemm memory bound pipeline (#1558)

2024-10-30 10:05:15 +01:00

block_gemm_problem.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

block_universal_gemm_as_bs_cr.hpp

CK-Tile first draft of universal block gemm with interwave & intrawave scheduler (#1676)

2024-11-26 08:45:14 +01:00