Qianfeng fb42be79dc Add separate mask checking for scope [aligned_physical_seqlen_k_start, physical_seqlen_k_end) (#2487) ...

* Add separate mask checking for scope [aligned_physical_seqlen_k_start, physical_seqlen_k_end) in pagedkv pipeline

* i_nhead_ conversion type to prevent overflow

---------

Co-authored-by: ltqin <letaoqin@amd.com>

[ROCm/composable_kernel commit: 45904b8fd7]

2025-07-11 18:14:47 +08:00

..

add_rmsnorm2d_rdquant

[A8W8 GEMM] Optimized weight-preshuffled implementation & add quantization datatype for CK TILE rms_norm (#1862)

2025-02-20 14:00:27 -08:00

batched_transpose

Vectorized Transpose for Batched Transpose CK Tile Operator (#2131)

2025-05-12 00:41:45 -07:00

common

chore: unset executable permission (#2303)

2025-06-10 09:13:59 -07:00

elementwise

[CK_TILE] Multiple-D GEMM example (#2219)

2025-06-13 19:39:11 +02:00

epilogue

[CK TILE] Grouped Convolution Forward Kernel (#2188)

2025-06-20 15:44:36 -07:00

flatmm

[CK_TILE] Refine fp8 support in flatmm (#2239)

2025-06-25 01:07:45 -07:00

fmha

Add separate mask checking for scope [aligned_physical_seqlen_k_start, physical_seqlen_k_end) (#2487)

2025-07-11 18:14:47 +08:00

fused_moe

[CK_TILE] Fix compilation errors introduced in #2320, #2219 and #2214 (#2388)

2025-06-23 12:29:15 +08:00

gemm

Enable Async Copy for MI355 (#2425)

2025-07-07 10:08:49 -07:00

grouped_convolution

[CK TILE] Grouped Convolution Forward Kernel (#2188)

2025-06-20 15:44:36 -07:00

image_to_column

Do not use warpSize as compile time constant as it is removed (#2320)

2025-06-17 11:54:30 -07:00

layernorm2d

[CK_TILE] Improve RMS/Layer Normalization 2 Pass Pipeline Performance (#1861)

2025-03-25 20:09:45 +08:00

norm_reduce

[CK_TILE] Fix compilation errors introduced in #2320, #2219 and #2214 (#2388)

2025-06-23 12:29:15 +08:00

permute

Remove virtual destructors from unary ops (#1610)

2024-10-30 17:42:50 +01:00

reduce/block

Do not use warpSize as compile time constant as it is removed (#2320)

2025-06-17 11:54:30 -07:00

rmsnorm2d

[CK_TILE] Improve RMS/Layer Normalization 2 Pass Pipeline Performance (#1861)

2025-03-25 20:09:45 +08:00

smoothquant

add fp8 as dst (#1830)

2025-01-22 17:34:27 +08:00

softmax/block

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

topk/block

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

topk_softmax

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

add_rmsnorm2d_rdquant.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

batched_transpose.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

common.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

elementwise.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

epilogue.hpp

Solve the Static Encoding Pattern compile error when the tile size is too small (#2079)

2025-04-13 20:09:30 -07:00

flatmm.hpp

[flatmm] implement basic fp16 flatmm (#2089)

2025-04-16 16:51:17 +08:00

fmha.hpp

ck tile pagedkv prefill (#2405)

2025-07-07 16:16:54 +08:00

fused_moe.hpp

[CK_TILE] moe sorting ex kernel to support expert > 128 (#1840)

2025-02-11 17:49:17 +08:00

gemm.hpp

ck tile pagedkv prefill (#2405)

2025-07-07 16:16:54 +08:00

grouped_convolution.hpp

[CK TILE] Grouped Convolution Forward Kernel (#2188)

2025-06-20 15:44:36 -07:00

image_to_column.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

layernorm2d.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

norm_reduce.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

permute.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

reduce.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

rmsnorm2d.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

smoothquant.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

softmax.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

topk_softmax.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

topk.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00