金黄色葡萄球君君 b5b3ba728d projects/composablekernel: add SwigluStep support for MoE blockscale (#6118) ...

## Summary
- add `swiglustep_and_mul` to the composablekernel MoE blockscale
activation enum
- implement the corresponding blockscale epilogue path for `SwigluStep`
- keep existing `silu` and `gelu` paths unchanged

## Scope
This PR covers the classic composablekernel blockscale MoE path under
`projects/composablekernel`.

This is separate from the `ck_tile` / FlatMM path being discussed in
ROCm/rocm-libraries#5992.

## Motivation
`Step-3.5-Flash-FP8` uses `SwigluStep` in its MoE MLP path. The
dependent AITER change needs native support for this activation in the
classic composablekernel MoE blockscale path.

## Validation
- patch is limited to two composablekernel files under
`projects/composablekernel`
- existing `silu` / `gelu` paths are unchanged
- dependent AITER runtime validation hit the classic CK 2-stage path
with AITER MoE enabled

2026-04-21 07:24:48 +00:00

..

batchnorm_multiblock

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gemm_layernorm

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

normalization

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

block_to_ctile_map.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

epilogue_cshuffle_v3_reduce_wmma.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

epilogue_cshuffle_v3_welford_wmma.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

epilogue_cshuffle_v3_wmma_base.hpp

Add support for direct store in epilogue and padding support for wave transfer without transpose (#3465)

2026-01-14 11:02:19 +01:00

epilogue_cshuffle_v3_wmma.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

epilogue_direct_store.hpp

Add support for direct store in epilogue and padding support for wave transfer without transpose (#3465)

2026-01-14 11:02:19 +01:00

gridwise_2d_multiple_reduction_multiblock.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_2d_multiple_reduction_threadwise.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_2d_reduction_multiblock.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_2d_reduction_threadwise_multi_d.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_2d_reduction_threadwise.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_ab_transfer_thread_tiles_preshuffle.hpp

Multi AB support for wave transfer (#3578)

2026-01-29 10:29:40 -08:00

gridwise_ab_transfer_thread_tiles.hpp

Multi AB support for wave transfer (#3578)

2026-01-29 10:29:40 -08:00

gridwise_ab_transfer_wave_tiles_interleave.hpp

Multi AB support for wave transfer (#3578)

2026-01-29 10:29:40 -08:00

gridwise_ab_transfer_wave_tiles.hpp

Multi AB support for wave transfer (#3578)

2026-01-29 10:29:40 -08:00

gridwise_batched_gemm_gemm_wmma_cshuffle_v3.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_batched_gemm_gemm_xdl_cshuffle_v1.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_batched_gemm_multiple_d_gemm_multiple_d_xdl_cshuffle_v1.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_batched_gemm_multiple_d_softmax_gemm_xdl_cshuffle_v1.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_batched_gemm_softmax_gemm_wmma_cshuffle.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_batched_gemm_softmax_gemm_xdl_cshuffle_v1.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_batchnorm_backward_blockwise_welford.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_batchnorm_forward_blockwise_welford.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_elementwise_1d_scale.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_elementwise_2d.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_elementwise_layernorm_welford_variance.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_fpAintB_gemm_wmma.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_bias_add_reduce_xdl_cshuffle_v1.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_gemm_dl_multiple_d.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_dl_v1r3.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_dpp.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_multiple_abd_xdl_cshuffle.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_multiple_d_multiple_r_xdl_cshuffle.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_gemm_multiple_d_wmma_cshuffle.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_multiple_d_xdl_cshuffle_lds_direct_load.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_multiple_d_xdl_cshuffle.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_multiple_d_xdl_splitk_cshuffle.hpp

173 implement device grouped gemm fixed nk for rdna4 (#4299)

2026-02-19 09:13:05 +01:00

gridwise_gemm_pipeline_selector.hpp

Simplify includes for CK builder reflection (#3357)

2025-12-05 07:44:10 -08:00

gridwise_gemm_pipeline_v1.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_pipeline_v2.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_pipeline_v3.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_pipeline_v4_direct_load.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_reduce_xdl_cshuffle_v1.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_gemm_split_k_multiple_d_xdl_cshuffle_v2.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_split_k_multiple_d_xdl_cshuffle.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_waveletmodel.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_wmma_cshuffle_v3_ab_scale.hpp

Wmma support for grouped convolution bwd weight (#2947)

2025-12-17 15:58:58 -08:00

gridwise_gemm_wmma_cshuffle_v3_common.hpp

Implement device_grouped_gemm_fixed_nk_bias for RDNA4 (#4340)

2026-02-26 00:28:09 +00:00

gridwise_gemm_wmma_cshuffle_v3.hpp

[CK] Unify the grouped convolution gridwise Run() functions (#4421)

2026-03-11 17:38:55 +01:00

gridwise_gemm_wmma.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_gemm_xdl_cshuffle_common.hpp

projects/composablekernel: add SwigluStep support for MoE blockscale (#6118)

2026-04-21 07:24:48 +00:00

gridwise_gemm_xdl_cshuffle_conv_v3.hpp

Grouped Conv Bwd Weight Direct Load (#3648)

2026-01-28 15:31:54 -06:00

gridwise_gemm_xdl_cshuffle_streamk_v3.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_xdl_cshuffle_v1.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdl_cshuffle_v2.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdl_cshuffle_v3_b_preshuffle.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_xdl_cshuffle_v3_b_scale.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_xdl_cshuffle_v3_multi_abd.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_xdl_cshuffle_v3_multi_d_ab_scale.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_xdl_cshuffle_v3_multi_d_b_preshuffle.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_xdl_cshuffle_v3_multi_d_blockscale_b_preshuffle.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdl_cshuffle_v3_multi_d.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_xdl_cshuffle_v3_mx_bpreshuffle.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_xdl_cshuffle_v3_mx.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_xdl_cshuffle_v3.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_gemm_xdl_layernorm_cshuffle_v1.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_gemm_xdl_waveletmodel_cshuffle.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdlops_bwd_weight.hpp

[Compiler] Addressing new compiler warnings (#3640)

2026-02-02 09:39:48 -08:00

gridwise_gemm_xdlops_skip_b_lds_v1.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdlops_splitk_lds_direct_load.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdlops_streamk.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdlops_v2r3.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdlops_v2r4.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdlops_v2r4r2.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdlops_v3r1.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdlops_v3r2.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_gemm_xdlops_v3r3.hpp

[ck] add gridwise base class for in all xdl kernel (#186) (#3544)

2026-01-27 12:49:47 -08:00

gridwise_moe_gemm_blockscale.hpp

projects/composablekernel: add SwigluStep support for MoE blockscale (#6118)

2026-04-21 07:24:48 +00:00

gridwise_moe_gemm.hpp

[CK] use int64 for ptr offset (#5094)

2026-03-05 18:00:01 -08:00

gridwise_moe_mx_gemm_bns.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_moe_mx_gemm_bpreshuffle.hpp

[CK] use int64 for ptr offset (#5094)

2026-03-05 18:00:01 -08:00

gridwise_moe_mx_gemm.hpp

CK: Remove 41 commented-out dead code blocks (~200 lines) (#6302)

2026-04-10 11:17:11 -04:00

gridwise_permute.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_put_element_1d.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_set_buffer_value.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_set_multiple_buffer_value.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

gridwise_softmax.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_sparse_embeddings_forward_layernorm_builtins.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_sparse_embeddings_forward_layernorm.hpp

[CK] Replace nested static_for with static_ford to reduce device IR function emissions [1B] (#5031)

2026-03-18 08:45:22 -06:00

gridwise_tensor_rearrange.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00