rocking 5948dbffe4 Support fp8 dynamic quantization for fmha (#3206) ...

* Support qscale for dynamic quant, remove static quant

* Support hdim=256

* Remove bias test case for fp8

---------

Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com>
Co-authored-by: asleepzzz <hanwen.chang@amd.com>

2025-11-24 16:28:25 +08:00

..

block_fmha_batch_prefill_pipeline_qr_ks_vs_async_default_policy.hpp

[CK_TILE] Add logits soft-capping & customization support to the FMHA forward kernel/pipelines (#2163)

2025-05-13 12:19:25 +08:00

block_fmha_batch_prefill_pipeline_qr_ks_vs_async.hpp

[CK_TILE] Refine FP32 => FP16/BF16 Conversion (#3215)

2025-11-20 10:50:26 -08:00

block_fmha_bwd_convert_dq.hpp

[CK_TILE] FA bwd kernels optimization (#1397)

2024-08-16 13:40:10 -07:00

block_fmha_bwd_dot_do_o.hpp

[CK_TILE] FA bwd kernels optimization (#1397)

2024-08-16 13:40:10 -07:00

block_fmha_bwd_dq_dk_dv_pipeline_kr_ktr_vr_iglp.hpp

[CK_TILE] FMHA BWD Pad HDim to a Multiple of 8 (#2918)

2025-09-26 16:42:59 +08:00

block_fmha_bwd_dq_dk_dv_pipeline_kr_ktr_vr.hpp

[CK_TILE] FMHA BWD Pad HDim to a Multiple of 8 (#2918)

2025-09-26 16:42:59 +08:00

block_fmha_bwd_dq_dk_dv_pipeline_selector.hpp

[CK_TILE] FMHA BWD Pad HDim to a Multiple of 8 (#2918)

2025-09-26 16:42:59 +08:00

block_fmha_bwd_dq_dk_dv_pipeline_trload_kr_ktr_vr.hpp

[CK_TILE] FMHA BWD Pad HDim to a Multiple of 8 (#2918)

2025-09-26 16:42:59 +08:00

block_fmha_bwd_dq_dk_dv_pipeline_trload_qr_qtr_dor.hpp

[CK_TILE] FMHA BWD Pad HDim to a Multiple of 8 (#2918)

2025-09-26 16:42:59 +08:00

block_fmha_bwd_pipeline_default_policy.hpp

[CK_TILE] Support WMMA (gfx12) in FMHA (#2528)

2025-10-29 13:31:08 -07:00

block_fmha_bwd_pipeline_problem.hpp

[CK_TILE] FMHA BWD Pad HDim to a Multiple of 8 (#2918)

2025-09-26 16:42:59 +08:00

block_fmha_bwd_pipeline_trload_default_policy.hpp

Reapply "[CK_TILE] FMHA BWD Enable Tile 16x192 (#2741)" (#2757) (#2761)

2025-09-08 09:21:14 -07:00

block_fmha_fwd_appendkv_pipeline_default_policy.hpp

[CK_TILE] Add PagedAttention kernels (#1387)

2024-08-28 20:50:43 +08:00

block_fmha_fwd_appendkv_pipeline.hpp

[CK_TILE] Add PagedAttention kernels (#1387)

2024-08-28 20:50:43 +08:00

block_fmha_fwd_pagedkv_pipeline_qr_ks_vs_default_policy.hpp

[CK_TILE] Support WMMA (gfx12) in FMHA (#2528)

2025-10-29 13:31:08 -07:00

block_fmha_fwd_pagedkv_pipeline_qr_ks_vs.hpp

Revert "Add attn sink (#2892)" (#3250)

2025-11-20 07:55:15 -08:00

block_fmha_fwd_splitkv_combine_pipeline_default_policy.hpp

[CK_TILE] Support WMMA (gfx12) in FMHA (#2528)

2025-10-29 13:31:08 -07:00

block_fmha_fwd_splitkv_combine_pipeline.hpp

[CK_TILE] Support WMMA (gfx12) in FMHA (#2528)

2025-10-29 13:31:08 -07:00

block_fmha_fwd_splitkv_pipeline_nwarp_sshuffle_qr_ks_vs_default_policy.hpp

Ck tile/complete k prefetch (#1941)

2025-03-07 14:19:51 +08:00

block_fmha_fwd_splitkv_pipeline_nwarp_sshuffle_qr_ks_vs.hpp

Revert "Add attn sink (#2892)" (#3250)

2025-11-20 07:55:15 -08:00

block_fmha_fwd_splitkv_pipeline_qr_ks_vs_default_policy.hpp

Ck tile/complete k prefetch (#1941)

2025-03-07 14:19:51 +08:00

block_fmha_fwd_splitkv_pipeline_qr_ks_vs.hpp

Revert "Add attn sink (#2892)" (#3250)

2025-11-20 07:55:15 -08:00

block_fmha_fwd_v3_pipeline_default_policy.hpp

[CK-tile] unhardcode the number of LDS banks from universal gemm policy (#3130)

2025-10-31 11:58:11 -07:00

block_fmha_fwd_v3_pipeline.hpp

[CK_TILE] FMHA FAv3 scheduling fine-tuning for performance (#2833)

2025-09-16 11:32:38 +08:00

block_fmha_pipeline_enum.hpp

Re-enable optimization for gfx950 fmha fwd (#2671)

2025-08-13 14:57:43 +08:00

block_fmha_pipeline_problem.hpp

Support fp8 dynamic quantization for fmha (#3206)

2025-11-24 16:28:25 +08:00

block_fmha_pipeline_qr_ks_vs_async_default_policy.hpp

Ck tile/complete k prefetch (#1941)

2025-03-07 14:19:51 +08:00

block_fmha_pipeline_qr_ks_vs_async_trload_policy.hpp

[CK_TILE] Support WMMA (gfx12) in FMHA (#2528)

2025-10-29 13:31:08 -07:00

block_fmha_pipeline_qr_ks_vs_async_trload.hpp

Revert "Add attn sink (#2892)" (#3250)

2025-11-20 07:55:15 -08:00

block_fmha_pipeline_qr_ks_vs_async.hpp

[CK_TILE] Refine FP32 => FP16/BF16 Conversion (#3215)

2025-11-20 10:50:26 -08:00

block_fmha_pipeline_qr_ks_vs_default_policy.hpp

Ck tile/complete k prefetch (#1941)

2025-03-07 14:19:51 +08:00

block_fmha_pipeline_qr_ks_vs_fp8.hpp

[CK_TILE] FMHA Reduce register spilling in fwd with dropout (workaround for CI failures with clang-22) (#3221)

2025-11-19 10:40:12 +05:00

block_fmha_pipeline_qr_ks_vs_whole_k_prefetch_default_policy.hpp

[CK-tile] unhardcode the number of LDS banks from universal gemm policy (#3130)

2025-10-31 11:58:11 -07:00

block_fmha_pipeline_qr_ks_vs_whole_k_prefetch.hpp

[CK_TILE] FMHA Reduce register spilling in fwd with dropout (workaround for CI failures with clang-22) (#3221)

2025-11-19 10:40:12 +05:00

block_fmha_pipeline_qr_ks_vs.hpp

Revert "Add attn sink (#2892)" (#3250)

2025-11-20 07:55:15 -08:00

block_fmha_pipeline_qs_ks_vs_default_policy.hpp

Ck tile/complete k prefetch (#1941)

2025-03-07 14:19:51 +08:00

block_fmha_pipeline_qs_ks_vs.hpp

[CK_TILE] FMHA Reduce register spilling in fwd with dropout (workaround for CI failures with clang-22) (#3221)

2025-11-19 10:40:12 +05:00

block_fmha_pipeline_qx_ks_vs_custom_policy.hpp

[CK_TILE] FMHA Reduce register spilling in fwd with dropout (workaround for CI failures with clang-22) (#3221)

2025-11-19 10:40:12 +05:00

tile_fmha_shape.hpp

[CK_TILE] Support f32 in FMHA (fwd and bwd) (#2836)

2025-09-27 18:03:48 +05:00

tile_fmha_traits.hpp

Support fp8 dynamic quantization for fmha (#3206)

2025-11-24 16:28:25 +08:00