Po Yen Chen fb1ccfa9df [CK_TILE] Add paged-kvcache support in group mode fmha fwd splitkv kernels (#1678) ...

* Generate group mode paged-attn kernel

* Enable paged-kvcache + group mode support

* Add missing header: fused_moe.hpp

* Add comment to explain kernel arg usage

* Make error message more clear

* Add comment for confusing data member names

* Add more comment for confusing variable names

* Fix typo in option description

2024-11-21 14:53:10 +08:00

..

__init__.py

[CK_TILE] fmha forward split-kv + combine kernels (#1338)

2024-06-26 17:41:15 +08:00

fmha_bwd.py

[CK_TILE] FA bwd kernels optimization (#1397)

2024-08-16 13:40:10 -07:00

fmha_fwd_appendkv.py

[CK_TILE] Add PagedAttention kernels (#1387)

2024-08-28 20:50:43 +08:00

fmha_fwd_splitkv.py

[CK_TILE] Add paged-kvcache support in group mode fmha fwd splitkv kernels (#1678)

2024-11-21 14:53:10 +08:00

fmha_fwd.py

[CK_TILE] Add fmha fwd headdim96 support (#1608)

2024-10-30 14:03:16 +08:00