Po Yen Chen 28cd0dffc9 [CK_TILE] FMHA forward batch_prefill optimization for low CU utilization (#2251) ...

* Add constraint on traits/tile/pipeline

* Use kM0=128 if max_seqlen_q == 8192

* Re-format codegen script

* Remove redundant attr name postix

* Fix import error: default field in dataclass

* Use kK0=64 & kK1=64 to hide latency

* Use CU utilization to decide tile size

2025-05-29 18:36:33 +09:00

..

ops

[CK_TILE] FMHA forward batch_prefill optimization for low CU utilization (#2251)

2025-05-29 18:36:33 +09:00

__init__.py

[CK_TILE] fmha forward split-kv + combine kernels (#1338)

2024-06-26 17:41:15 +08:00

cmake_config.py

[CK_TILE] fmha forward split-kv + combine kernels (#1338)

2024-06-26 17:41:15 +08:00

cpp_symbol_map.py

[CK_TILE] Add logits soft-capping & customization support to the FMHA forward kernel/pipelines (#2163)

2025-05-13 12:19:25 +08:00