Po Yen Chen cf2d635ea2 [CK_TILE] Fix incorrect computation of group mode PagedAttention (#1688) ...

* Allow getting batch size from splitkv tile partitioner

* Fix wrong paged-kvcache impl for group mode

* Fix wrong example code for page-kvcache

* Undo changes in fmha_fwd.cpp

* Always use 2D block table

* Add is_gappy kernel argument for paged-kvcache

The is_gappy argument is used for differentiating seqstart_k_ptr usage
in flash-attention & xformers

* Remove out-of-date comments

* Remove no-longer used method

* Fix wrong # page-block calculation

* Fix wrong comment

---------

Co-authored-by: Qianfeng <qianfeng.zhang@amd.com>

2024-11-26 20:37:54 +08:00

..

block_fmha_bwd_convert_dq.hpp

[CK_TILE] FA bwd kernels optimization (#1397)

2024-08-16 13:40:10 -07:00

block_fmha_bwd_dot_do_o.hpp

[CK_TILE] FA bwd kernels optimization (#1397)

2024-08-16 13:40:10 -07:00

block_fmha_bwd_dq_dk_dv_pipeline_kr_ktr_vr_iglp.hpp

[CK_TILE] Improve headdim96 performance for fmha-bwd (#1573)

2024-10-16 18:14:32 +08:00

block_fmha_bwd_dq_dk_dv_pipeline_kr_ktr_vr.hpp

[CK_TILE] Improve headdim96 performance for fmha-bwd (#1573)

2024-10-16 18:14:32 +08:00

block_fmha_bwd_pipeline_default_policy.hpp

[CK_TILE] Improve headdim96 performance for fmha-bwd (#1573)

2024-10-16 18:14:32 +08:00

block_fmha_bwd_pipeline_enum.hpp

[CK_TILE] FA bwd kernels optimization (#1397)

2024-08-16 13:40:10 -07:00

block_fmha_bwd_pipeline_problem.hpp

[CK_TILE] FA bwd kernels optimization (#1397)

2024-08-16 13:40:10 -07:00

block_fmha_fwd_appendkv_pipeline_default_policy.hpp

[CK_TILE] Add PagedAttention kernels (#1387)

2024-08-28 20:50:43 +08:00

block_fmha_fwd_appendkv_pipeline.hpp

[CK_TILE] Add PagedAttention kernels (#1387)

2024-08-28 20:50:43 +08:00

block_fmha_fwd_splitkv_combine_pipeline_default_policy.hpp

[CK_TILE] Optimize fmha splitkv & splitkv combine kernels (#1577)

2024-10-21 10:52:11 +08:00

block_fmha_fwd_splitkv_combine_pipeline.hpp

[CK_TILE] Optimize fmha splitkv & splitkv combine kernels (#1577)

2024-10-21 10:52:11 +08:00

block_fmha_fwd_splitkv_pipeline_qr_ks_vs_default_policy.hpp

[CK_TILE] More fmha splitkv optimizations (#1588)

2024-10-26 18:35:45 +08:00

block_fmha_fwd_splitkv_pipeline_qr_ks_vs.hpp

[CK_TILE] Fix incorrect computation of group mode PagedAttention (#1688)

2024-11-26 20:37:54 +08:00

block_fmha_pipeline_enum.hpp

[CK_TILE] support alibi (#1269)

2024-05-07 22:32:54 +08:00

block_fmha_pipeline_problem.hpp

[CK_TILE] More fmha splitkv optimizations (#1588)

2024-10-26 18:35:45 +08:00

block_fmha_pipeline_qr_ks_vs_async_default_policy.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

block_fmha_pipeline_qr_ks_vs_async.hpp

[CK_TILE] fused-moe first version (#1634)

2024-11-26 11:14:56 +08:00

block_fmha_pipeline_qr_ks_vs_default_policy.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

block_fmha_pipeline_qr_ks_vs_fp8.hpp

[CK_TILE] Add fmha fwd headdim96 support (#1608)

2024-10-30 14:03:16 +08:00

block_fmha_pipeline_qr_ks_vs.hpp

[CK_TILE] Add fmha fwd headdim96 support (#1608)

2024-10-30 14:03:16 +08:00

block_fmha_pipeline_qs_ks_vs_default_policy.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

block_fmha_pipeline_qs_ks_vs.hpp

[CK_TILE] Add fmha fwd headdim96 support (#1608)

2024-10-30 14:03:16 +08:00

block_fmha_pipeline_qx_ks_vs_custom_policy.hpp

[CK Tile] Improve the Layout, Padding, and Alignment features of CK Tile GEMM (#1651)

2024-11-11 18:08:25 -08:00

tile_fmha_shape.hpp

Remove virtual destructors from unary ops (#1610)

2024-10-30 17:42:50 +01:00

tile_fmha_traits.hpp

Change in fwd-splitkv kernel to support num_splits=1 case (#1690)

2024-11-25 12:31:38 +08:00