ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-03 21:21:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
dc1e9c5df9e022b130337cc31fd8a32f6ce1efa7
composable_kernel/include/ck/tensor_operation/gpu/grid
History
Bartłomiej Kocot dc1e9c5df9 Support large tensors in grouped conv fwd (#1332) 
* Support large tensors in grouped conv fwd

* Multi ABD fixes

* Fix calculate element space size
2024-06-14 09:53:03 -05:00
..
batchnorm_multiblock
[HotFix] add config and version files to pass on build info (#856)
2023-08-23 11:36:17 -07:00
gemm_layernorm
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
normalization
layernorm and groupnorm backward data (#1083)
2023-12-19 04:23:11 +08:00
block_to_ctile_map.hpp
Code clean-up (#1285)
2024-05-10 09:41:39 -07:00
gridwise_2d_multiple_reduction_multiblock.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_2d_multiple_reduction_threadwise.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_2d_reduction_multiblock.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_2d_reduction_threadwise.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_batched_gemm_gemm_xdl_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_batched_gemm_multiple_d_gemm_multiple_d_xdl_cshuffle_v1.hpp
Navi3 rel (#1176)
2024-03-08 17:11:51 -08:00
gridwise_batched_gemm_multiple_d_softmax_gemm_xdl_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_batched_gemm_softmax_gemm_wmma_cshuffle.hpp
Navi3 rel (#1176)
2024-03-08 17:11:51 -08:00
gridwise_batched_gemm_softmax_gemm_xdl_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_batchnorm_backward_blockwise_welford.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_batchnorm_forward_blockwise_welford.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_elementwise_1d_scale.hpp
Refactor elementwise kernels (#1222)
2024-04-19 13:31:17 +02:00
gridwise_elementwise_2d.hpp
Refactor elementwise kernels (#1222)
2024-04-19 13:31:17 +02:00
gridwise_elementwise_layernorm_welford_variance.hpp
enable compilation of INSTANCES_ONLY for Windows (#1082)
2023-12-20 14:34:53 -08:00
gridwise_fpAintB_gemm_wmma.hpp
aggregate device macros in ck_tile config header (#1297)
2024-05-20 08:34:45 -07:00
gridwise_gemm_bias_add_reduce_xdl_cshuffle_v1.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_dl_multiple_d.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_gemm_dl_v1r3.hpp
Redesign the DPP8 GEMM kernel to use warp-wise component (#863)
2023-09-06 11:44:09 -05:00
gridwise_gemm_dpp.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_multiple_abd_xdl_cshuffle.hpp
bf16A_Int8B with fastgelu/bias (#1264)
2024-04-26 07:26:30 -05:00
gridwise_gemm_multiple_d_multiple_r_xdl_cshuffle.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_multiple_d_wmma_cshuffle.hpp
Support large tensors in grouped conv fwd (#1332)
2024-06-14 09:53:03 -05:00
gridwise_gemm_multiple_d_xdl_cshuffle_lds_direct_load.hpp
Implement direct loads split-K GEMM kernel (#1137)
2024-02-07 01:08:34 +01:00
gridwise_gemm_multiple_d_xdl_cshuffle.hpp
Grouped GEMM Multiple D tile loop. (#1247)
2024-04-25 15:12:53 -05:00
gridwise_gemm_multiple_d_xdl_splitk_cshuffle.hpp
improved zeroing (#1221)
2024-04-02 11:02:52 -05:00
gridwise_gemm_pipeline_selector.hpp
Grouped GEMM Multiple D tile loop. (#1247)
2024-04-25 15:12:53 -05:00
gridwise_gemm_pipeline_v1.hpp
Navi3 rel (#1176)
2024-03-08 17:11:51 -08:00
gridwise_gemm_pipeline_v2.hpp
Fixed Gemmv2r3 kpad (#938)
2023-09-26 18:40:00 -05:00
gridwise_gemm_pipeline_v3.hpp
initial stream-k implementation with example (#699)
2023-07-26 14:18:15 -05:00
gridwise_gemm_pipeline_v4_direct_load.hpp
Add support for double buffering in direct load GEMM kernel (#1052)
2023-12-03 23:08:47 +01:00
gridwise_gemm_reduce_xdl_cshuffle_v1.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_split_k_multiple_d_xdl_cshuffle_v2.hpp
Fp16/fp8 mixed-precision Gemm with multiply+add fusion (#865)
2023-08-28 16:27:32 -05:00
gridwise_gemm_split_k_multiple_d_xdl_cshuffle.hpp
Navi3 rel (#1176)
2024-03-08 17:11:51 -08:00
gridwise_gemm_waveletmodel.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_gemm_wmma.hpp
Navi3 rel (#1176)
2024-03-08 17:11:51 -08:00
gridwise_gemm_xdl_cshuffle_bwd_weight_v3.hpp
Optimize grouped conv bwd weight for small M and N (#1303)
2024-05-22 21:01:01 +02:00
gridwise_gemm_xdl_cshuffle_v1.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdl_cshuffle_v2.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdl_cshuffle_v3_multi_abd.hpp
Optimize grouped conv bwd weight for small M and N (#1303)
2024-05-22 21:01:01 +02:00
gridwise_gemm_xdl_cshuffle_v3_multi_d.hpp
Post-merge fix of PR 1300 (#1313)
2024-05-31 22:46:41 -07:00
gridwise_gemm_xdl_cshuffle_v3.hpp
Integrate universal gemm with conv forward (#1320)
2024-06-05 13:01:29 -05:00
gridwise_gemm_xdl_layernorm_cshuffle_v1.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdl_waveletmodel_cshuffle.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_xdlops_bwd_weight.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_skip_b_lds_v1.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_splitk_lds_direct_load.hpp
aggregate device macros in ck_tile config header (#1297)
2024-05-20 08:34:45 -07:00
gridwise_gemm_xdlops_streamk.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_v2r3.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_v2r4.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_v2r4r2.hpp
replace the ENV macro with CK_ENV (#1296)
2024-05-17 10:42:51 -07:00
gridwise_gemm_xdlops_v3r1.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_v3r2.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_gemm_xdlops_v3r3.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00
gridwise_permute.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_put_element_1d.hpp
Average pool backward deviceOP and example (#797)
2023-08-10 12:04:35 +08:00
gridwise_set_buffer_value.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_set_multiple_buffer_value.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_softmax.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_sparse_embeddings_forward_layernorm.hpp
[HotFix] add config and version files to pass on build info (#856)
2023-08-23 11:36:17 -07:00
gridwise_tensor_rearrange.hpp
Add support for more Navi2x and Navi3x models. (#1152)
2024-02-02 11:35:26 -08:00