ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-15 18:42:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
6c7e2d3a7e0787651db033cb50a8b35b6c5233bd
composable_kernel/include/ck/tensor_operation/gpu/device
History
ltqin 6c7e2d3a7e Skip lds of b matrix (#326) 
* start

* read for gridwise gemm

* add MakeBGridDescriptor_K0_N0_N1_N2_N3_K1

* add thread  copy desc and register buffer

* add K0PerBlock dim

* add read global data

* finish gridwise gemm

* finish blockwise gemm

* add print data

* add smallest config

* add compare code for gridwis gemm

* fix NXdlPerWave

* fix k0perthread and gridewis gemm main loop

* remove b matrix lds alloc

* fix name

* add test code

* create b_grid_desc_k0_k1_k2_n0_n1_n2_n3_k3 from parameter

* add double register

* modify b_thread_desc_

* add float

* fp16 tag

* add tail for pipeline

* finish main loop

* optimize main loop

* start clear gridwise gemm

* clear code

* clear redundant code

* change file name

* change file name

* fix bug after merge develop

* fix input parameters

* using MultiK0 control b load data loop

* fix some config

* 4 buffer

* fix bug

* one can use

* change read order

* change buffer array to tuple

* change to 8 buffer

* interleave buffer load

* change to 16

* read 8 buffer

* add data buffer to template

* fix after merge develop(head file)

* format

* change to 4 buffer

* remove unnecessary lambda fun

[ROCm/composable_kernel commit: 10b3278b05]
2022-08-13 01:35:49 -05:00
..
convolution_backward_data_specialization.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
convolution_backward_weight_specialization.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
convolution_forward_specialization.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_5ary_elementwise.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_base.hpp
add license in file (#303)
2022-06-24 23:32:43 -05:00
device_batched_contraction_multiple_d_xdl_cshuffle.hpp
add g; fixed strides (#355)
2022-08-12 15:22:39 -05:00
device_batched_contraction_multiple_d.hpp
Add batched/grouped_gemm contraction deviceOps (#349)
2022-08-10 12:20:29 -05:00
device_batched_gemm_e_permute_xdl.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_batched_gemm_e_permute.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_batched_gemm_gemm.hpp
Fused attention (#345)
2022-08-13 00:16:14 -05:00
device_batched_gemm_multi_d_xdl.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_batched_gemm_multi_d.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_batched_gemm_reduce_xdl_cshuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_batched_gemm_softmax_gemm_xdl_cshuffle.hpp
Fused attention (#345)
2022-08-13 00:16:14 -05:00
device_batched_gemm_softmax_gemm.hpp
Fused attention (#345)
2022-08-13 00:16:14 -05:00
device_batched_gemm_xdl.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_batched_gemm.hpp
Gemm+Bilinear (#316)
2022-07-02 09:15:38 -05:00
device_binary_elementwise.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_cgemm_4gemm_xdl_cshuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_cgemm.hpp
add license in file (#303)
2022-06-24 23:32:43 -05:00
device_contraction_multiple_d_xdl_cshuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_contraction_multiple_d.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_conv2d_backward_weight_xdl_c_shuffle_nhwc_kyxc_nhwk.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_conv2d_bwd_data_xdl_nhwc_kyxc_nhwk.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_conv2d_fwd_xdl_c_shuffle_bias_activation_add_nhwc_kyxc_nhwk.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_conv2d_fwd_xdl_c_shuffle_bias_activation_nhwc_kyxc_nhwk.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_conv2d_fwd_xdl_c_shuffle_nhwc_kyxc_nhwk.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_conv2d_fwd_xdl_nhwc_kyxc_nhwk.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_conv3d_fwd_naive_ndhwc_kzyxc_ndhwk.hpp
add license in file (#303)
2022-06-24 23:32:43 -05:00
device_conv3d_fwd_xdl_ndhwc_kzyxc_ndhwk.hpp
add license in file (#303)
2022-06-24 23:32:43 -05:00
device_conv_bwd_data.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_conv_bwd_weight.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_conv_fwd_bias_activation_add.hpp
add license in file (#303)
2022-06-24 23:32:43 -05:00
device_conv_fwd_bias_activation.hpp
add license in file (#303)
2022-06-24 23:32:43 -05:00
device_conv_fwd.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_convnd_bwd_data_nwc_kxc_nwk_xdl.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_convnd_bwd_weight_nwc_kxc_nwk_xdl_cshuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_elementwise.hpp
external api for gemm + layernorm (#285)
2022-06-27 14:25:10 -05:00
device_gemm_bias_add_reduce_xdl_cshuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_bias_e_permute_xdl.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_bias_e_permute.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_dl.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_multiple_d_multiple_r_xdl_cshuffle.hpp
Gemm multiple d multiple r (#335)
2022-08-13 01:07:12 -05:00
device_gemm_multiple_d_multiple_r.hpp
Gemm multiple d multiple r (#335)
2022-08-13 01:07:12 -05:00
device_gemm_multiple_d_xdl_cshuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_multiple_d.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_reduce_xdl_cshuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_reduce.hpp
Improve external interface for GEMM and GEMM+add+add+fastgelu (#311)
2022-06-30 22:11:00 -05:00
device_gemm_splitk.hpp
Improve external interface for GEMM and GEMM+add+add+fastgelu (#311)
2022-06-30 22:11:00 -05:00
device_gemm_xdl_cshuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_xdl_layernorm_cshuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_xdl_skip_b_lds.hpp
Skip lds of b matrix (#326)
2022-08-13 01:35:49 -05:00
device_gemm_xdl_splitk_c_shuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_xdl_splitk.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm_xdl.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_gemm.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_grouped_contraction_multiple_d_xdl_cshuffle.hpp
Add batched/grouped_gemm contraction deviceOps (#349)
2022-08-10 12:20:29 -05:00
device_grouped_contraction_multiple_d.hpp
Add batched/grouped_gemm contraction deviceOps (#349)
2022-08-10 12:20:29 -05:00
device_grouped_conv_fwd_multiple_d_xdl_cshuffle.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_grouped_conv_fwd_multiple_d.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_grouped_gemm_xdl.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_grouped_gemm.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_layernorm.hpp
ckProfiler for layernorm (#330)
2022-08-11 17:03:54 -05:00
device_normalization.hpp
ckProfiler for layernorm (#330)
2022-08-11 17:03:54 -05:00
device_pool2d_fwd_nhwc_nhwc.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_pool2d_fwd.hpp
add license in file (#303)
2022-06-24 23:32:43 -05:00
device_reduce_common.hpp
add license in file (#303)
2022-06-24 23:32:43 -05:00
device_reduce_multiblock.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_reduce_threadwise.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_reduce.hpp
add license in file (#303)
2022-06-24 23:32:43 -05:00
device_softmax.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
device_unary_elementwise.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
gemm_specialization.hpp
Gemm+Bilinear (#316)
2022-07-02 09:15:38 -05:00
matrix_padder.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
reduction_operator_mapping.hpp
add license in file (#303)
2022-06-24 23:32:43 -05:00
tensor_layout.hpp
Clean up conv example, Instances, profiler and test (#324)
2022-07-29 18:19:25 -05:00
tensor_specialization.hpp
Add batched/grouped_gemm contraction deviceOps (#349)
2022-08-10 12:20:29 -05:00