Gino Lu d939c3b4fc sparse_attn: split-launch dispatch + 3-mode PV-skip ...

- Per-head pv_threshold via head_remap LUT (CLI: -pv_threshold_per_head);
  sentinel 1e30 routes to kEnablePVSkip=false bucket
- kEnablePVSkip bool → PVSkipMode enum {kNone, kPerWarp, kPerBlock};
  new kPerBlock matches upstream sm80 (LDS vote, V loads unconditional).
  CLI: -pv_mode={none,warp,block}, default warp
- README: PV-skip modes section + MI300X 3-curve sparsity chart

Co-Authored-By: Claude Opus 4 <noreply@anthropic.com>

2026-05-19 21:45:23 -04:00

..

add_rmsnorm2d_rdquant

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

batched_contraction

[CK Tile] batched contraction kernel generalizing (#3126)

2025-12-02 13:30:27 +01:00

batched_transpose

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

common

[rocm-libraries] ROCm/rocm-libraries#6838 (commit ff7a665)

2026-05-15 13:48:51 +00:00

elementwise

[rocm-libraries] ROCm/rocm-libraries#6399 (commit 13bf528)

2026-04-14 07:45:14 +00:00

epilogue

[rocm-libraries] ROCm/rocm-libraries#5863 (commit 31d9247)

2026-04-14 20:23:26 +00:00

flatmm

[rocm-libraries] ROCm/rocm-libraries#6302 (commit 8d419e8)

2026-04-10 15:18:02 +00:00

fmha

[rocm-libraries] ROCm/rocm-libraries#7016 (commit 2b73c00)

2026-05-19 13:42:43 +00:00

fused_moe

[rocm-libraries] ROCm/rocm-libraries#6242 (commit f46ac14)

2026-04-23 22:45:32 +00:00

gemm

[rocm-libraries] ROCm/rocm-libraries#6574 (commit b3db057)

2026-04-30 18:33:36 +00:00

gemm_mx

[rocm-libraries] ROCm/rocm-libraries#5849 (commit d9b89b2)

2026-03-27 20:37:23 +00:00

gemm_quant

[rocm-libraries] ROCm/rocm-libraries#5939 (commit 6fb1791)

2026-04-07 14:38:07 +00:00

grouped_convolution

[rocm-libraries] ROCm/rocm-libraries#6838 (commit ff7a665)

2026-05-15 13:48:51 +00:00

image_to_column

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

layernorm2d

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

norm_reduce

[rocm-libraries] ROCm/rocm-libraries#6302 (commit 8d419e8)

2026-04-10 15:18:02 +00:00

permute

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

pooling

Shuffle fix for gfx950 (#3491)

2026-01-13 09:21:29 -08:00

reduce

[rocm-libraries] ROCm/rocm-libraries#6302 (commit 8d419e8)

2026-04-10 15:18:02 +00:00

rmsnorm2d

Fix redundant cast in model sensitive rmsnorm (#3681)

2026-01-30 10:52:19 +08:00

sageattention

[rocm-libraries] ROCm/rocm-libraries#6574 (commit b3db057)

2026-04-30 18:33:36 +00:00

smoothquant

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

softmax/block

[rocm-libraries] ROCm/rocm-libraries#4274 (commit 7c380df)

2026-02-11 05:52:42 +00:00

sparse_attn

sparse_attn: split-launch dispatch + 3-mode PV-skip

2026-05-19 21:45:23 -04:00

topk/block

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

topk_softmax

Shuffle fix for gfx950 (#3491)

2026-01-13 09:21:29 -08:00

add_rmsnorm2d_rdquant.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

batched_contraction.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

batched_transpose.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

common.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

elementwise.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

epilogue.hpp

[rocm-libraries] ROCm/rocm-libraries#5863 (commit 31d9247)

2026-04-14 20:23:26 +00:00

flatmm.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

fmha.hpp

[rocm-libraries] ROCm/rocm-libraries#6209 (commit 89c9f3e)

2026-04-24 16:31:59 +00:00

fused_moe.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

gemm_mx.hpp

[rocm-libraries] ROCm/rocm-libraries#5241 (commit 43daeac)

2026-03-12 08:27:49 +00:00

gemm_quant.hpp

[rocm-libraries] ROCm/rocm-libraries#4964 (commit 3271d9a)

2026-03-16 08:31:56 +00:00

gemm.hpp

[rocm-libraries] ROCm/rocm-libraries#4964 (commit 3271d9a)

2026-03-16 08:31:56 +00:00

grouped_convolution.hpp

[rocm-libraries] ROCm/rocm-libraries#6838 (commit ff7a665)

2026-05-15 13:48:51 +00:00

image_to_column.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

layernorm2d.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

moe_flatmm.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

norm_reduce.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

permute.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

pooling.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

reduce.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

rmsnorm2d.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

sageattn.hpp

[rocm-libraries] ROCm/rocm-libraries#6574 (commit b3db057)

2026-04-30 18:33:36 +00:00

smoothquant.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

softmax.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

sparse_attn.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

topk_softmax.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00

topk.hpp

[rocm-libraries] ROCm/rocm-libraries#4294 (commit 6601702)

2026-03-02 12:21:44 +00:00