ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-15 02:27:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
fbbbce4fb43897c9af496b0e81cbda0f82d179fa
composable_kernel/include/ck/tensor_operation/gpu/grid
History
Bartlomiej Wroblewski fbbbce4fb4 Add basic support for direct loads from global to LDS (#999) 
* Add basic support for direct loads from global to LDS

* Clean the code and comments

* Add support for fp16

* Add comments

* Add check for thread cluster lengths

* Align non-direct-load fp16 example

* Small fixes

* Extend IsSupported to check for supported GPU gens

* Build examples only on the supported HW

* Do not throw when instance not supported in 04 example

* Review: Apply review suggestions

* Review: small fix

* Review: small fix

[ROCm/composable_kernel commit: 627054b941]
2023-11-25 13:35:22 +01:00
..
batchnorm_multiblock
[HotFix] add config and version files to pass on build info (#856)
2023-08-23 11:36:17 -07:00
gemm_layernorm
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
normalization
Backward of gamma and beta for layernorm and groupnorm (#1013)
2023-11-10 18:02:03 +08:00
block_to_ctile_map.hpp
Revert "Grouped Gemm with looping over the tiles. (#788)" (#982)
2023-10-11 14:27:29 -05:00
gridwise_2d_multiple_reduction_multiblock.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_2d_multiple_reduction_threadwise.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_2d_reduction_multiblock.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_2d_reduction_threadwise.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_batched_gemm_gemm_xdl_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_batched_gemm_multiple_d_gemm_multiple_d_xdl_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_batched_gemm_multiple_d_softmax_gemm_xdl_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_batched_gemm_softmax_gemm_xdl_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_batchnorm_backward_blockwise_welford.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_batchnorm_forward_blockwise_welford.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_elementwise_1d_scale.hpp
Hip tensor permute (#1002)
2023-11-13 11:15:48 -06:00
gridwise_elementwise_1d.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_elementwise_2d.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_elementwise_3d.hpp
Transpose 3d (#984)
2023-11-08 19:45:07 -06:00
gridwise_elementwise_layernorm_welford_variance.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_gemm_bias_add_reduce_xdl_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_dl_multiple_d.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_gemm_dl_v1r3.hpp
Redesign the DPP8 GEMM kernel to use warp-wise component (#863)
2023-09-06 11:44:09 -05:00
gridwise_gemm_dpp.hpp
Enable DPP8 GEMM on Navi3 (#892)
2023-09-08 11:14:57 -05:00
gridwise_gemm_multiple_abd_xdl_cshuffle.hpp
Support multi AB for grouped conv fwd xdl (#1027)
2023-11-10 15:54:44 +01:00
gridwise_gemm_multiple_d_multiple_r_xdl_cshuffle.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_multiple_d_wmma_cshuffle.hpp
Add grouped conv bwd weight wmma (#985)
2023-10-17 10:32:26 +02:00
gridwise_gemm_multiple_d_xdl_cshuffle_lds_direct_load.hpp
Add basic support for direct loads from global to LDS (#999)
2023-11-25 13:35:22 +01:00
gridwise_gemm_multiple_d_xdl_cshuffle.hpp
Grouped conv bwd data with fp16 input and bf8fp8 comp (#962)
2023-10-04 18:04:27 -05:00
gridwise_gemm_multiple_d_xdl_splitk_cshuffle.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_pipeline_selector.hpp
Add basic support for direct loads from global to LDS (#999)
2023-11-25 13:35:22 +01:00
gridwise_gemm_pipeline_v1.hpp
Redesign the DPP8 GEMM kernel to use warp-wise component (#863)
2023-09-06 11:44:09 -05:00
gridwise_gemm_pipeline_v2.hpp
Fixed Gemmv2r3 kpad (#938)
2023-09-26 18:40:00 -05:00
gridwise_gemm_pipeline_v3.hpp
initial stream-k implementation with example (#699)
2023-07-26 14:18:15 -05:00
gridwise_gemm_pipeline_v4_direct_load.hpp
Add basic support for direct loads from global to LDS (#999)
2023-11-25 13:35:22 +01:00
gridwise_gemm_reduce_xdl_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_split_k_multiple_d_xdl_cshuffle_v2.hpp
Fp16/fp8 mixed-precision Gemm with multiply+add fusion (#865)
2023-08-28 16:27:32 -05:00
gridwise_gemm_split_k_multiple_d_xdl_cshuffle.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_waveletmodel.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_gemm_wmma.hpp
[HotFix] add config and version files to pass on build info (#856)
2023-08-23 11:36:17 -07:00
gridwise_gemm_xdl_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_xdl_layernorm_cshuffle_v1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_xdl_waveletmodel_cshuffle.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_xdlops_bwd_weight.hpp
Add conv bwd weight fp16 comp bf8 fp8 op, instances and example (#945)
2023-10-04 08:19:08 -05:00
gridwise_gemm_xdlops_skip_b_lds_v1.hpp
Enable gfx941 and gfx942 architectures. (#752)
2023-06-15 08:20:59 -07:00
gridwise_gemm_xdlops_streamk.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_xdlops_v2r3.hpp
Fix MNKPadding in gridwise_gemm_xdlops_v2r3 (#981)
2023-10-10 21:48:07 +02:00
gridwise_gemm_xdlops_v2r4.hpp
Enable gfx941 and gfx942 architectures. (#752)
2023-06-15 08:20:59 -07:00
gridwise_gemm_xdlops_v2r4r2.hpp
Add Gemm instances for performance improvement (#1018)
2023-11-07 09:09:58 -06:00
gridwise_gemm_xdlops_v3r1.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_xdlops_v3r2.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_gemm_xdlops_v3r3.hpp
Add fp8 @ bf8 gemm support and example (#933)
2023-10-02 16:39:03 -05:00
gridwise_permute.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_put_element_1d.hpp
Average pool backward deviceOP and example (#797)
2023-08-10 12:04:35 +08:00
gridwise_set_buffer_value.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_set_multiple_buffer_value.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_softmax.hpp
update copyright headers (#726)
2023-05-31 18:46:57 -05:00
gridwise_sparse_embeddings_forward_layernorm.hpp
[HotFix] add config and version files to pass on build info (#856)
2023-08-23 11:36:17 -07:00
gridwise_tensor_rearrange.hpp
Add support for groups in Img2Col/Col2Img (#1007)
2023-10-31 10:46:32 +01:00