ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-02 12:41:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,120 Commits 734 Branches 37 Tags
963dfa680bebb6b85308f82d9a4e2c68ece1aa06
Commit Graph

2 Commits

Author SHA1 Message Date
carlushuang
6df5fe2ad8 [CK_TILE]naive attn support FP8 KVCache quant (#1747) 
* quant

* fix bug

* simple smoothquant after softmax

* update kv-quant

* update stride

* fix fp8-pertoken-kvcache

* update int8/fp8 quant support

---------

Co-authored-by: so <a.com>
Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>
 2025-01-03 18:43:07 +08:00
carlushuang
77a38e0211 [CK_TILE] naive attn (#1708) 
* add reference attention fwd

* refactor addresser

* update

* paged, and i8 reflect-quant

* lets call it forward-quant

* fix error in decode variation

* update naive-attn

* fix page table

* fix build err
 2024-12-12 11:54:03 +08:00