Johannes Graner f173642087 [CK] Refactor GPU verification kernel to gather error stats on GPU (#3551) ...

* Refactor GPU verification kernel to gather erorr stats on GPU

* Check if result is all zero

* non-negative error count doesn't need custom Atomics

* Remove unnecessary AtomicMaxFloat function

* Simpler warp reduction, remove passed flag

* Move verification header to include

* Fix header path in test

* Fix block reduction loop

2026-01-14 16:04:50 +01:00

..

common.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

data_type_enum.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_avg_pool2d_bwd_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_avg_pool3d_bwd_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batched_gemm_add_relu_gemm_add_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batched_gemm_b_scale_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batched_gemm_bias_softmax_gemm_permute_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batched_gemm_gemm_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batched_gemm_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batched_gemm_reduce_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batched_gemm_softmax_gemm_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batched_gemm_softmax_gemm_permute_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batchnorm_backward_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batchnorm_forward_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_batchnorm_infer_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_contraction_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_contraction_utils.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_conv_bwd_data_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_conv_fwd_bias_relu_add_impl.hpp

Profile resnet layout fixes (#3360)

2025-12-05 08:20:46 -08:00

profile_conv_fwd_bias_relu_impl.hpp

Profile resnet layout fixes (#3360)

2025-12-05 08:20:46 -08:00

profile_conv_fwd_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_conv_tensor_rearrange_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_elementwise_layernorm_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_ab_scale_impl.hpp

Wmma support for gemm_ab_scale (#3314)

2025-12-11 09:06:20 +01:00

profile_gemm_add_add_fastgelu_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_add_fastgelu_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_add_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_add_multiply_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_add_relu_add_layernorm_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_add_relu_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_add_silu_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_b_scale_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_bias_add_reduce_impl.hpp

Wmma support for gemm_bias_add_reduce (#3316)

2026-01-07 10:27:16 -08:00

profile_gemm_bilinear_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_blockscale_wp_impl.hpp

Wmma support for gemm_ab_scale (#3314)

2025-12-11 09:06:20 +01:00

profile_gemm_fastgelu_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_multi_abd_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_multiply_add_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_multiply_multiply_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_multiply_multiply_wp_impl.hpp

Wmma support for gemm_multiply_multiply_wp (#3278)

2025-12-03 07:38:23 -08:00

profile_gemm_mx_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_quantization_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_reduce_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_splitk_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_streamk_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_universal_batched_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_universal_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_universal_preshuffle_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_universal_reduce_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_gemm_universal_streamk_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_grouped_conv_bwd_data_impl.hpp

[CK] Refactor GPU verification kernel to gather error stats on GPU (#3551)

2026-01-14 16:04:50 +01:00

profile_grouped_conv_bwd_weight_impl.hpp

[CK] Refactor GPU verification kernel to gather error stats on GPU (#3551)

2026-01-14 16:04:50 +01:00

profile_grouped_conv_fwd_bias_bnorm_clamp_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_grouped_conv_fwd_bias_clamp_impl.hpp

Grouped convolution forward device implementation and base flavors for RDNA3/4 (#2964)

2025-12-18 13:12:15 -07:00

profile_grouped_conv_fwd_bilinear_impl.hpp

Adding support for scale and bilinear ops for WMMA grouped conv fwd (#3450)

2025-12-19 15:15:02 +01:00

profile_grouped_conv_fwd_impl.hpp

[CK] Refactor GPU verification kernel to gather error stats on GPU (#3551)

2026-01-14 16:04:50 +01:00

profile_grouped_conv_fwd_outelementop_impl.hpp

Adding support for scale and bilinear ops for WMMA grouped conv fwd (#3450)

2025-12-19 15:15:02 +01:00

profile_grouped_gemm_fastgelu_impl.hpp

Implement grouped gemm fastgelu for RDNA4 (#3303)

2026-01-07 10:20:44 -08:00

profile_grouped_gemm_fixed_nk_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_grouped_gemm_impl.hpp

Implement grouped gemm fastgelu for RDNA4 (#3303)

2026-01-07 10:20:44 -08:00

profile_grouped_gemm_multiply_tile_loop_impl.hpp

Implement grouped gemm tile loop for RDNA4 (#3304)

2026-01-13 07:14:23 +01:00

profile_grouped_gemm_tile_loop_generic_impl.hpp

Implement grouped gemm tile loop for RDNA4 (#3304)

2026-01-13 07:14:23 +01:00

profile_grouped_gemm_tile_loop_impl.hpp

Implement grouped gemm tile loop for RDNA4 (#3304)

2026-01-13 07:14:23 +01:00

profile_groupnorm_bwd_data_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_groupnorm_bwd_gamma_beta_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_groupnorm_fwd_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_layernorm_bwd_data_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_layernorm_bwd_gamma_beta_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_layernorm_fwd_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_max_pool2d_bwd_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_max_pool3d_bwd_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_permute_scale_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_pool2d_fwd_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_pool3d_fwd_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_reduce_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_softmax_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00

profile_transpose_impl.hpp

chore(copyright): update copyright header for profiler directory (#3205)

2025-11-14 11:19:25 -08:00