Po Yen Chen 791802b381 [CK_TILE] fMHA batch_prefill block index & logits soft-capping optimizations (#2198) ...

* Write soft-sign in inline asm

* Change tile idx computation

* Add macro to turn off soft-sign asm opt

* Use simple for loop to avoid register spill

* Only do block id transform for masking cases

2025-05-16 15:14:46 +08:00

..

block_attention_bias_enum.hpp

[CK_TILE] support alibi (#1269)

2024-05-07 22:32:54 +08:00

block_dropout.hpp

[CK_TILE] FA bwd kernels optimization (#1397)

2024-08-16 13:40:10 -07:00

block_masking.hpp

Ck tile/paged attention workaround (#1894)

2025-02-17 14:29:25 +08:00

block_position_encoding.hpp

[CK_TILE] Add PagedAttention kernels (#1387)

2024-08-28 20:50:43 +08:00

block_rotary_embedding.hpp

[CK_TILE] Add PagedAttention kernels (#1387)

2024-08-28 20:50:43 +08:00

page_block_navigator.hpp

Return nullptr when block index is invalid (#1649)

2024-11-11 09:28:32 +08:00

variants.hpp

[CK_TILE] fMHA batch_prefill block index & logits soft-capping optimizations (#2198)

2025-05-16 15:14:46 +08:00