rocking5566 d4d1147f0a Refine layernorm naming and test code (#497) ...

* Sync the naming

* Sync the test of layernorm with groupnorm

* Sync the naming

* Minor change for comment and log

* [What] Add saveMean and SaveInvVariance in the interface.
[Why] These can optimize the backward

2022-11-02 16:57:28 -06:00

..

batchnorm_multiblock

Batchnorm-forward implemented using welford method to calculate variance (#403)

2022-10-27 18:52:54 -06:00

block_to_ctile_map.hpp

Example contraction splitk (#430)

2022-10-11 17:54:34 -05:00

gridwise_2d_multiple_reduction_multiblock.hpp

Batchnorm-forward and Batchnorm-infer Implemented using generic kernels (#320)

2022-08-15 10:11:02 -05:00

gridwise_2d_multiple_reduction_threadwise.hpp

Batchnorm-forward and Batchnorm-infer Implemented using generic kernels (#320)

2022-08-15 10:11:02 -05:00

gridwise_2d_reduction_multiblock.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

gridwise_2d_reduction_threadwise.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

gridwise_batched_gemm_gemm_xdl_cshuffle_v1.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_batched_gemm_multiple_d_gemm_multiple_d_xdl_cshuffle_v1.hpp

batched_gemm + multiple_d + gemm + multiple_d (#394)

2022-09-14 17:54:18 -05:00

gridwise_batched_gemm_softmax_gemm_xdl_cshuffle_v1.hpp

remove atten kernel workarounds as we move over to rocm 5.3 (#496)

2022-11-02 16:56:07 -06:00

gridwise_batchnorm_forward_blockwise_welford.hpp

Batchnorm-forward implemented using welford method to calculate variance (#403)

2022-10-27 18:52:54 -06:00

gridwise_contraction_dlops_v1r2.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

gridwise_elementwise_1d.hpp

Add 'Permute' device op & example (#408)

2022-09-19 21:30:25 -05:00

gridwise_gemm_bias_add_reduce_xdl_cshuffle_v1.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_dl_v1r3.hpp

Add Conv Forward on Navi21 for ResNet50 (#490)

2022-10-31 10:24:25 -06:00

gridwise_gemm_dlops_v1r2.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

gridwise_gemm_dlops_v2.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

gridwise_gemm_dlops_v3.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

gridwise_gemm_multiple_d_multiple_r_xdl_cshuffle.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_multiple_d_xdl_cshuffle.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_pipeline_selector.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_pipeline_v1.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_pipeline_v2.hpp

GEMM pipeline v2 (#317)

2022-07-08 15:55:14 -05:00

gridwise_gemm_reduce_xdl_cshuffle_v1.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_split_k_multiple_d_xdl_cshuffle.hpp

Example contraction splitk (#430)

2022-10-11 17:54:34 -05:00

gridwise_gemm_xdl_cshuffle_v1.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_xdl_layernorm_cshuffle_v1.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_xdlops_bwd_weight.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_xdlops_skip_b_lds_v1.hpp

Fused GEMM+GEMM (#351)

2022-08-13 09:18:58 -05:00

gridwise_gemm_xdlops_v2r3.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_xdlops_v2r4.hpp

add license in file (#303)

2022-06-24 23:32:43 -05:00

gridwise_gemm_xdlops_v2r4r2.hpp

Add examples of batched/grouped/SplitK Gemm for int8/bfp16/fp16/fp32 (#361)

2022-08-23 14:41:56 -05:00

gridwise_gemm_xdlops_v3r1.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_xdlops_v3r2.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_gemm_xdlops_v3r3.hpp

Add pipeline v1/v2 selector, add more instances (#381)

2022-11-02 16:50:48 -06:00

gridwise_normalization_naive_variance.hpp

Refine layernorm naming and test code (#497)

2022-11-02 16:57:28 -06:00

gridwise_normalization_welford_variance.hpp

Refine layernorm naming and test code (#497)

2022-11-02 16:57:28 -06:00

gridwise_permute.hpp

Add 'Permute' device op & example (#408)

2022-09-19 21:30:25 -05:00

gridwise_set_buffer_value.hpp

Batchnorm-forward implemented using welford method to calculate variance (#403)

2022-10-27 18:52:54 -06:00

gridwise_set_multiple_buffer_value.hpp

Batchnorm-forward and Batchnorm-infer Implemented using generic kernels (#320)

2022-08-15 10:11:02 -05:00

gridwise_softmax.hpp

fix standalone softmax race condition around blockwise reduction (#323)

2022-07-14 22:52:45 -05:00

gridwise_sparse_embedding3_forward_layernorm.hpp

embedding fuse layernorm (#405)

2022-09-09 10:41:15 -05:00