ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-04-19 22:39:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
e3556fed0453e66cdebc5dad6b903f5e902cd9b4
composable_kernel/include/ck_tile/ops/fmha
History
Jeff Huang e3556fed04 Optimize batch prefill kernel performance for VECTORIZED_LAYOUT KV cache (#3657) 
- Add multi-dimensional page index support (YsGatherDims) in tile_scatter_gather
- Add is_gather_dim() and get_gather_index() for multi-dim page lookup
- Override MakeVDramTileDistribution() for VECTORIZED_LAYOUT to match
  GEMM's BWarpDstrEncoding (K decomposition: {K2, K0, K1})
- Add GetGemmKDecomposition() to retrieve kABKLane and kKPerThread
- Add static_assert for RowMajor VLayout requirement in batch prefill

Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>
2026-01-29 07:18:41 +08:00
..
block
Revert "Revert " Fp8 block scale quantization for fmha fwd (#3330)" (#3633)" (#3635)
2026-01-23 09:03:22 -08:00
kernel
Revert "Revert " Fp8 block scale quantization for fmha fwd (#3330)" (#3633)" (#3635)
2026-01-23 09:03:22 -08:00
pipeline
Optimize batch prefill kernel performance for VECTORIZED_LAYOUT KV cache (#3657)
2026-01-29 07:18:41 +08:00