Enrico Degregori ce99cab605 Wmma support for gemm_ab_scale (#3314) ...

* Support gemm_ab_scale:

 - Add tests
 - Integrate scaling implementation in multiple D
 - Generalize existing b_scale for ab_scale
 - Add instances
 - Generalize implementation for ScaleBlockM, ScaleBlockN, ScaleBlockK
 - Add support for all layouts supported by xdl
 - Fix splitk xdl

* Fix copyright

* Wmma support for gemm_blockscale_wp (#3315)

* Support for  preshuffle with ab scale

 - add support for b preshuffle in GridwiseGemm_wmma_cshuffle_v3_ab_scale
 - add support for AScaleLayout amnd BScaleLayout (can be different
   from ALayout and BLayout, respectively)
 - add Run method in v1 pipeline to support preshuffle + scaling
 - add support for preshuffle gemms in common invoker
 - Add splitk support

* Fix copyright header

2025-12-11 09:06:20 +01:00

..

blockwise_gemm_dl_v2r3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_dlops_v2r2.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_dlops_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_dpp.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_mx_pipeline_xdlops_base.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_wmma_selector.hpp

Wmma support for gemm_multiply_multiply_wp (#3278)

2025-12-03 07:38:23 -08:00

blockwise_gemm_pipeline_wmmaops_base.hpp

Wmma support for gemm_ab_scale (#3314)

2025-12-11 09:06:20 +01:00

blockwise_gemm_pipeline_wmmaops_v1.hpp

Wmma support for gemm_ab_scale (#3314)

2025-12-11 09:06:20 +01:00

blockwise_gemm_pipeline_wmmaops_v3.hpp

Wmma support for gemm_ab_scale (#3314)

2025-12-11 09:06:20 +01:00

blockwise_gemm_pipeline_wmmaops.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_ab_scale_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_dequant_v1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_dequant_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_gufusion_dequant_v1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_gufusion_v1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_gufusion_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_mx_moe_gufusion_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_mx_moe_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_mx_moe_v1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_mx_moe_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_v1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_v2.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_preshuffle_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_b_scale_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_base.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_blockscale_b_preshuffle_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_blockscale_b_preshuffle_v1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_blockscale_b_preshuffle_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_moe_blockscale_b_preshuffle_gufusion_v1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_moe_blockscale_b_preshuffle_gufusion_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_moe_blockscale_b_preshuffle_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_moe_blockscale_b_preshuffle_v1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_moe_blockscale_b_preshuffle_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_mx_bpreshuffle_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_mx_moe_gufusion_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_mx_moe_nbs_gufusion_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_mx_moe_nbs_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_mx_moe_nbs_v1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_mx_moe_nbs_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_mx_moe_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_mx_moe_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_mx_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_selector.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v1_ab_scale.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v1_b_scale.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v1_mx.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v2_ab_scale.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v2_b_scale.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v2.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v3_ab_scale.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v3_b_scale.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v3_mx_bpreshuffle.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v3_mx.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v4_b_scale.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v4.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops_v5.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_pipeline_xdlops.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_smfmac_xdlops.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_wmma.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_xdlops_skip_b_lds.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_gemm_xdlops.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_softmax.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_tensor_slice_transfer_v5r1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

blockwise_welford.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

reduction_functions_blockwise.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_direct_load.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_gather_direct_load.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_global.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v4r1_dequant.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v4r1_gather.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v4r1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v4r2.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v6r1.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v6r1r2.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v6r2.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v6r3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v7.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v7r2.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v7r3_scatter.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00

thread_group_tensor_slice_transfer_v7r3.hpp

chore(copyright): update copyright header for include directory (#3224)

2025-11-18 10:17:18 -08:00