Anthony Chang 76764d8c92 Manual control of MAC cluster for improved interwave performance (#184) ...

* manual control of MAC cluster for improved 2-wave performance

ensure setprio's order; ensure inner loop size >= local read size

synchronize when single mac cluster

* format

* use value field from ck::integral_constant

* roll out inter-wave loop scheduler to c-shuffle gemm variants

will gradually roll out to other applicable device ops when occasional reg spill is resolved

* additional comments

* format

* fix mismatch between inter-wave pipeline and interwave blockwise gemm

* address review feedback

* amend

2022-05-10 19:19:22 -05:00

..

convolution_backward_data_specialization.hpp

Compile for gfx908 and gfx90a (#130)

2022-03-31 12:33:34 -05:00

convolution_forward_specialization.hpp

Compile for gfx908 and gfx90a (#130)

2022-03-31 12:33:34 -05:00

device_base.hpp

Reorganize files, Part 1 (#119)

2022-03-08 21:46:36 -06:00

device_batched_gemm_reduce_xdl_cshuffle.hpp

Manual control of MAC cluster for improved interwave performance (#184)

2022-05-10 19:19:22 -05:00

device_batched_gemm_xdl.hpp

Resolution of issue #153: Add compiler warning on comparing int and size_t (#212)

2022-05-09 15:06:49 -05:00

device_conv2d_backward_weight_xdl_c_shuffle_nhwc_kyxc_nhwk.hpp

NHWC Conv2d Bwd weight fp16 ckprofiler and test (#166)

2022-04-04 20:32:00 -05:00

device_conv2d_bwd_data_xdl_nhwc_kyxc_nhwk.hpp

Resolution of issue #153: Add compiler warning on comparing int and size_t (#212)

2022-05-09 15:06:49 -05:00

device_conv2d_fwd_xdl_c_shuffle_bias_activation_add_nhwc_kyxc_nhwk.hpp

Code refactor (#175)

2022-05-09 14:57:59 -05:00

device_conv2d_fwd_xdl_c_shuffle_bias_activation_nhwc_kyxc_nhwk.hpp

Code refactor (#175)

2022-05-09 14:57:59 -05:00

device_conv2d_fwd_xdl_c_shuffle_nhwc_kyxc_nhwk.hpp

Code refactor (#175)

2022-05-09 14:57:59 -05:00

device_conv2d_fwd_xdl_nhwc_kyxc_nhwk.hpp

Code refactor (#175)

2022-05-09 14:57:59 -05:00

device_conv3d_fwd_naive_ndhwc_kzyxc_ndhwk.hpp

Post PR183 review fixes. (#224)

2022-05-10 15:41:29 -05:00

device_conv3d_fwd_xdl_ndhwc_kzyxc_ndhwk.hpp

add comments to batched_gemm (#186)

2022-04-25 14:32:59 -05:00

device_conv_backward_weight.hpp

NHWC Conv2d Bwd weight fp16 ckprofiler and test (#166)

2022-04-04 20:32:00 -05:00

device_conv_bwd_data.hpp

Reorganize files, Part 1 (#119)

2022-03-08 21:46:36 -06:00

device_conv_fwd_bias_activation_add.hpp

Reorganize files, Part 1 (#119)

2022-03-08 21:46:36 -06:00

device_conv_fwd_bias_activation.hpp

Reorganize files, Part 1 (#119)

2022-03-08 21:46:36 -06:00

device_conv_fwd.hpp

Reorganize files, Part 1 (#119)

2022-03-08 21:46:36 -06:00

device_convnd_bwd_data_xdl_ndhwc_kzyxc_ndhwk.hpp

Resolution of issue #153: Add compiler warning on comparing int and size_t (#212)

2022-05-09 15:06:49 -05:00

device_convnd_fwd_xdl_nhwc_kyxc_nhwk.hpp

Resolution of issue #153: Add compiler warning on comparing int and size_t (#212)

2022-05-09 15:06:49 -05:00

device_gemm_bias_activation_add.hpp

Reorganize files, Part 1 (#119)

2022-03-08 21:46:36 -06:00

device_gemm_bias_activation.hpp

Reorganize files, Part 1 (#119)

2022-03-08 21:46:36 -06:00

device_gemm_bias.hpp

Gemm+Reduce Fusion (#128)

2022-03-23 22:18:42 -05:00

device_gemm_reduce_xdl_cshuffle.hpp

Manual control of MAC cluster for improved interwave performance (#184)

2022-05-10 19:19:22 -05:00

device_gemm_reduce.hpp

Update to gemm_reduce and batched_gemm_reduce (#213)

2022-04-29 11:35:25 -05:00

device_gemm_xdl_c_shuffle_bias_2d.hpp

Code refactor (#175)

2022-05-09 14:57:59 -05:00

device_gemm_xdl_c_shuffle_bias_activation_add.hpp

Code refactor (#175)

2022-05-09 14:57:59 -05:00

device_gemm_xdl_c_shuffle_bias_activation.hpp

Code refactor (#175)

2022-05-09 14:57:59 -05:00

device_gemm_xdl_cshuffle.hpp

Manual control of MAC cluster for improved interwave performance (#184)

2022-05-10 19:19:22 -05:00

device_gemm_xdl_splitk_c_shuffle.hpp

Compile for gfx908 and gfx90a (#130)

2022-03-31 12:33:34 -05:00

device_gemm_xdl_splitk.hpp

Compile for gfx908 and gfx90a (#130)

2022-03-31 12:33:34 -05:00

device_gemm_xdl.hpp

Code refactor (#175)

2022-05-09 14:57:59 -05:00

device_gemm.hpp

batched_gemm: use profiler in ctest (#163)

2022-03-30 21:32:49 -05:00

device_grouped_gemm_xdl.hpp

Resolution of issue #153: Add compiler warning on comparing int and size_t (#212)

2022-05-09 15:06:49 -05:00

device_pool2d_fwd_nhwc_nhwc.hpp

Compile for gfx908 and gfx90a (#130)

2022-03-31 12:33:34 -05:00

device_pool2d_fwd.hpp

Compile for gfx908 and gfx90a (#130)

2022-03-31 12:33:34 -05:00

device_reduce_blockwise_second_call.hpp

Reduction for int8 and bfloat16 (#125)

2022-03-22 14:35:14 -05:00

device_reduce_blockwise.hpp

Reduction for int8 and bfloat16 (#125)

2022-03-22 14:35:14 -05:00

device_reduce_common.hpp

Reduction for int8 and bfloat16 (#125)

2022-03-22 14:35:14 -05:00

device_reduce_multiblock_atomic_add.hpp

Reduction for int8 and bfloat16 (#125)

2022-03-22 14:35:14 -05:00

device_reduce_multiblock_partial_reduce.hpp

Reduction for int8 and bfloat16 (#125)

2022-03-22 14:35:14 -05:00

device_reduce_threadwise.hpp

Reduction for int8 and bfloat16 (#125)

2022-03-22 14:35:14 -05:00

device_reduce.hpp

Reduction for int8 and bfloat16 (#125)

2022-03-22 14:35:14 -05:00

gemm_specialization.hpp

Compile for gfx908 and gfx90a (#130)

2022-03-31 12:33:34 -05:00

reduction_operator_mapping.hpp

Compile for gfx908 and gfx90a (#130)

2022-03-31 12:33:34 -05:00

tensor_layout.hpp

batched_gemm: use profiler in ctest (#163)

2022-03-30 21:32:49 -05:00