Rostyslav Geyyer 1a0b0e7bec Add pipeline v1/v2 selector, add more instances (#381) ...

* Add gridwise gemm pipeline v1/v2 selector

* Pipeline selector working, test-wise add pipeline options to one instance

* Add gemm instances

* Add debug info to DeviceGemmXdl

* Add debug info to DeviceGemmXdl_CShuffle

* Add debug info to DeviceGemmXdl_CShuffle and instances to gemm_add_add_fastgelu

* Minor fix

* Add debug info to DeviceBatchedGemmXdl and instances to batched_gemm

* set up inter-wave configuration

* use defualt loop scheduling for supported gemm ops

for blanket-applying interwave scheduling for all supported gemm ops, define macro CK_EXPERIMENTAL_DEFAULT_TO_INTER_WAVE_SCHEDULING=1. this should be discouraged though as it is not covered by CI

* Add enum PipelineVersion

* Update instances

* Format

* Fix the merge conflict

* Add flags to disable added instances

* Test disable flag check

* Disable flag check

* Enable the instances

Co-authored-by: Anthony Chang <ac.chang@outlook.com>

2022-11-02 16:50:48 -06:00

..

blockwise_gemm_dl_v2r3.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

blockwise_gemm_dlops_v2r2.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

blockwise_gemm_dlops_v3.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

blockwise_gemm_xdlops_skip_b_lds.hpp

Fused GEMM+GEMM (#351)

2022-08-13 09:18:58 -05:00

blockwise_gemm_xdlops.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

blockwise_softmax.hpp

Fused attention instances & padding tests (#395)

2022-09-06 14:38:56 -05:00

blockwise_tensor_slice_transfer_v5r1.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

blockwise_welford.hpp

Layernorm welford (#346)

2022-08-13 09:43:18 -05:00

reduction_functions_blockwise.hpp

Fused attention (#345)

2022-08-13 00:16:14 -05:00

thread_group_tensor_slice_transfer_v4r1.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

thread_group_tensor_slice_transfer_v6r1.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

thread_group_tensor_slice_transfer_v6r2.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

thread_group_tensor_slice_transfer_v6r3.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

thread_group_tensor_slice_transfer_v7.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00