PoYen, Chen 59e1d9b84f Shift rotary_cos/rotary_sin by cache_seqlen_k

2024-07-24 05:06:47 +00:00

..

fmha_bwd_kernel.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

fmha_bwd_tile_partitioner.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

fmha_fwd_appendkv_kernel.hpp

Shift rotary_cos/rotary_sin by cache_seqlen_k

2024-07-24 05:06:47 +00:00

fmha_fwd_appendkv_tile_partitioner.hpp

Fix wrong grid size

2024-07-23 14:20:52 +00:00

fmha_fwd_kernel.hpp

Fix in dropout lambda to avoid the compiling issue on some docker/compiler envs (#1350)

2024-06-20 11:36:42 +08:00

fmha_fwd_splitkv_combine_kernel.hpp

[CK_TILE] fmha forward split-kv + combine kernels (#1338)

2024-06-26 17:41:15 +08:00

fmha_fwd_splitkv_combine_tile_partitioner.hpp

[CK_TILE] fmha forward split-kv + combine kernels (#1338)

2024-06-26 17:41:15 +08:00

fmha_fwd_splitkv_kernel.hpp

[CK_TILE] fmha forward split-kv + combine kernels (#1338)

2024-06-26 17:41:15 +08:00

fmha_fwd_splitkv_tile_partitioner.hpp

[CK_TILE] fmha forward split-kv + combine kernels (#1338)

2024-06-26 17:41:15 +08:00

fmha_fwd_tile_partitioner.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00