2 Commits

Author	SHA1	Message	Date
carlushuang	6df5fe2ad8	[CK_TILE]naive attn support FP8 KVCache quant (#1747) ... * quant * fix bug * simple smoothquant after softmax * update kv-quant * update stride * fix fp8-pertoken-kvcache * update int8/fp8 quant support --------- Co-authored-by: so <a.com> Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>	2025-01-03 18:43:07 +08:00
carlushuang	77a38e0211	[CK_TILE] naive attn (#1708) ... * add reference attention fwd * refactor addresser * update * paged, and i8 reflect-quant * lets call it forward-quant * fix error in decode variation * update naive-attn * fix page table * fix build err	2024-12-12 11:54:03 +08:00