juuso-oskari 374536f19a CK-UA: checkpoint FA4 pipeline + int64 Q/O base-offset fix ...

Working state before the pipeline cleanup/refactor:
  * FA4 matrix-softmax warp-group overlap pipeline (UA_FA4_PIPELINE=1).
  * Widen per-CTA query/output base offsets to long_index_t so large
    total_q (big-batch prefill) can't overflow int32 and fault on the
    output store (cache_ptr_int32_overflow_possible only covers K/V).

Co-authored-by: Cursor <cursoragent@cursor.com>

2026-06-03 08:47:43 +00:00

..

add_rmsnorm2d_rdquant

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

batched_contraction

[CK Tile] batched contraction kernel generalizing (#3126)

2025-12-02 13:30:27 +01:00

batched_transpose

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

common

[rocm-libraries] ROCm/rocm-libraries#5393 (commit d51b649)

2026-03-27 09:18:14 +00:00

elementwise

[rocm-libraries] ROCm/rocm-libraries#5237 (commit ef10dc6)

2026-03-13 01:21:08 +00:00

epilogue

[rocm-libraries] ROCm/rocm-libraries#5729 (commit 516c974)

2026-03-31 03:40:25 +00:00

flatmm

[rocm-libraries] ROCm/rocm-libraries#5045 (commit 64a5502)

2026-03-03 21:55:14 +00:00

fmha

CK-UA: revert unrelated fmha touches not consumed by unified_attention

2026-05-27 13:24:11 +00:00

fused_moe

[rocm-libraries] ROCm/rocm-libraries#4819 (commit b995a0b)

2026-02-25 16:13:13 +00:00

gemm

CK-UA: enable FP8 (e4m3) for prefill/m128 and the 32x32x16 small-tile decode variants

2026-05-15 17:34:50 +00:00

gemm_mx

[rocm-libraries] ROCm/rocm-libraries#5849 (commit d9b89b2)

2026-03-27 20:37:23 +00:00

gemm_quant

[rocm-libraries] ROCm/rocm-libraries#5323 (commit 5454e9e)

2026-03-17 18:58:56 +00:00

grouped_convolution

[rocm-libraries] ROCm/rocm-libraries#5842 (commit 04c5690)

2026-03-31 08:03:41 +00:00

image_to_column

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

layernorm2d

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

norm_reduce

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

permute

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

pooling

Shuffle fix for gfx950 (#3491)

2026-01-13 09:21:29 -08:00

reduce

[CK Tile] multi reduce improvements (#3607)

2026-01-27 12:56:09 -08:00

rmsnorm2d

Fix redundant cast in model sensitive rmsnorm (#3681)

2026-01-30 10:52:19 +08:00

smoothquant

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

softmax/block

[rocm-libraries] ROCm/rocm-libraries#4274 (commit 7c380df)

2026-02-11 05:52:42 +00:00

sparse_attn

[CK_TILE][FMHA] Add sparse attention VSA (#3341)

2026-01-31 00:59:47 +08:00

topk/block

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

topk_softmax

Shuffle fix for gfx950 (#3491)

2026-01-13 09:21:29 -08:00

unified_attention

CK-UA: checkpoint FA4 pipeline + int64 Q/O base-offset fix

2026-06-03 08:47:43 +00:00

add_rmsnorm2d_rdquant.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

batched_contraction.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

batched_transpose.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

common.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

elementwise.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

epilogue.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

flatmm.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

fmha.hpp

[rocm-libraries] ROCm/rocm-libraries#4368 (commit 17f7dfc)

2026-03-11 10:00:52 +00:00

fused_moe.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

gemm_mx.hpp

[rocm-libraries] ROCm/rocm-libraries#5241 (commit 43daeac)

2026-03-12 08:27:49 +00:00

gemm_quant.hpp

[rocm-libraries] ROCm/rocm-libraries#4964 (commit 3271d9a)

2026-03-16 08:31:56 +00:00

gemm.hpp

[rocm-libraries] ROCm/rocm-libraries#4964 (commit 3271d9a)

2026-03-16 08:31:56 +00:00

grouped_convolution.hpp

[rocm-libraries] ROCm/rocm-libraries#5241 (commit 43daeac)

2026-03-12 08:27:49 +00:00

image_to_column.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

layernorm2d.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

moe_flatmm.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

norm_reduce.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

permute.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

pooling.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

reduce.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

rmsnorm2d.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

smoothquant.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

softmax.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

sparse_attn.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

topk_softmax.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

topk.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

unified_attention.hpp

Add unified attention (42_unified_attention)

2026-04-01 16:39:15 +00:00