Files
composable_kernel/example
Amir Ghamarian 5f9b03746d Expand medium tier dispatch threshold for multi-seq prefill
Raise the medium tier boundary from avg_q <= 32 to avg_q <= 128.
This routes prefill shapes with 76-253 sequences (avg query length
32-108) to the 4-warp kBlockM=128 kernel instead of the 8-warp
kBlockM=256 kernel.

Results on affected shapes (via aiter):
  76-seq prefill:  1.44x vs Triton -> 1.03x (near-tied)
  157-seq prefill: 1.61x -> 1.02x
  181-seq prefill: 1.74x -> 1.00x (tied)
  229-seq prefill: 1.77x -> 1.05x

Made-with: Cursor
2026-03-28 11:28:21 +00:00
..
2026-01-14 07:31:45 -08:00