composable_kernel

mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-02 04:31:25 +00:00

Files

ltqin 9f4c5d7372 ck tile pagedkv prefill (#2405 )

* add prefetching physical block id for pagedkv

* start add pagedkv prefill

* rename pipeline

* add kernel for pagedkv

* add an init version pagedkv prefill

* fix redefine issue

* add struct BlockFmhaFwdPagedKVPipelineProblem and fmha_fwd_pagedkv_args

* generate dispatch code

* add body generating code

* comipling pass

* remove dropout from pagedkv

* set lse to false in generating code

* start changing qr kernel to pagedkv

* init version of  kernerl with pagedkv

* change names of file that are generated

* chang host validation for pagedkv prefill

* using iglp to change blockgemm

* add kernel files to op head file

* show parameters

* rewrite print parameter fun

* add fwd

* remove default parameter of GridSize

* format

* fix nhead issue and add seqlen_k_ptr to batch mode

* format code

* remove no-longer used code

* format

* fix some comments

---------

Co-authored-by: ltqin <letaoqin@amd.com>
Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>

2025-07-07 16:16:54 +08:00

__init__.py

[CK_TILE] fmha forward split-kv + combine kernels (#1338 )

2024-06-26 17:41:15 +08:00

fmha_batch_prefill.py

[CK_TILE] FMHA forward batch_prefill optimization for low CU utilization (#2251 )

2025-05-29 18:36:33 +09:00

fmha_bwd.py

[CK_TILE] Add logits soft-capping & customization support to the FMHA forward kernel/pipelines (#2163 )

2025-05-13 12:19:25 +08:00

fmha_fwd_appendkv.py

Only generate specific hdim (#2120 )