Anton Gorenko ca6143f0b2 Add a workaround for a compiler issue for bwd on gfx90a and ROCm 7.1.1 (#3369) ...

Sometimes there are not enough wait-states between v_mfma_f32... and v_accvgpr_read_b32 instructions if they are separated by s_cbranch.
The workaround is to read accvgprs to vgpr before branching.

2025-12-08 07:44:17 -08:00

..

block_fmha_batch_prefill_pipeline_qr_ks_vs_async_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_batch_prefill_pipeline_qr_ks_vs_async.hpp

fp8 fmha async pipeline (#3339)

2025-12-04 12:18:25 +08:00

block_fmha_bwd_convert_dq.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_bwd_dot_do_o.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_bwd_dq_dk_dv_pipeline_kr_ktr_vr_iglp.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_bwd_dq_dk_dv_pipeline_kr_ktr_vr.hpp

Add a workaround for a compiler issue for bwd on gfx90a and ROCm 7.1.1 (#3369)

2025-12-08 07:44:17 -08:00

block_fmha_bwd_dq_dk_dv_pipeline_selector.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_bwd_dq_dk_dv_pipeline_trload_kr_ktr_vr.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_bwd_dq_dk_dv_pipeline_trload_qr_qtr_dor.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_bwd_pipeline_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_bwd_pipeline_problem.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_bwd_pipeline_trload_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_appendkv_pipeline_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_appendkv_pipeline.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_pagedkv_pipeline_qr_ks_vs_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_pagedkv_pipeline_qr_ks_vs.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_splitkv_combine_pipeline_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_splitkv_combine_pipeline.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_splitkv_pipeline_nwarp_sshuffle_qr_ks_vs_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_splitkv_pipeline_nwarp_sshuffle_qr_ks_vs.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_splitkv_pipeline_qr_ks_vs_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_splitkv_pipeline_qr_ks_vs.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_v3_pipeline_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_fwd_v3_pipeline.hpp

[CK_TILE][FMHA] Integrate FAv2 & FAv3 (WIP) in the single fmha_fwd() API (#3153)

2025-12-05 10:31:12 +08:00

block_fmha_pipeline_enum.hpp

[CK_TILE][FMHA] Integrate FAv2 & FAv3 (WIP) in the single fmha_fwd() API (#3153)

2025-12-05 10:31:12 +08:00

block_fmha_pipeline_problem.hpp

[CK_TILE][FMHA] Integrate FAv2 & FAv3 (WIP) in the single fmha_fwd() API (#3153)

2025-12-05 10:31:12 +08:00

block_fmha_pipeline_qr_ks_vs_async_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qr_ks_vs_async_trload_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qr_ks_vs_async_trload.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qr_ks_vs_async.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qr_ks_vs_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qr_ks_vs_fp8.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qr_ks_vs_whole_k_prefetch_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qr_ks_vs_whole_k_prefetch.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qr_ks_vs.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qs_ks_vs_default_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qs_ks_vs.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

block_fmha_pipeline_qx_ks_vs_custom_policy.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

tile_fmha_shape.hpp

chore(copyright): update copyright header for include directory (#3293)

2025-11-26 11:00:05 -07:00

tile_fmha_traits.hpp

[CK_TILE][FMHA] Integrate FAv2 & FAv3 (WIP) in the single fmha_fwd() API (#3153)

2025-12-05 10:31:12 +08:00