ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-14 18:17:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,638 Commits 743 Branches 38 Tags
6472bdb4edee2c528599d2ef34f88dcb0ae4c8a7
Commit Graph

2 Commits

Author SHA1 Message Date
carlushuang
60e814a3ba [CK_TILE]naive attn support FP8 KVCache quant (#1747) 
* quant

* fix bug

* simple smoothquant after softmax

* update kv-quant

* update stride

* fix fp8-pertoken-kvcache

* update int8/fp8 quant support

---------

Co-authored-by: so <a.com>
Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>

[ROCm/composable_kernel commit: 6df5fe2ad8]
 2025-01-03 18:43:07 +08:00
carlushuang
b675a4d4ba [CK_TILE] naive attn (#1708) 
* add reference attention fwd

* refactor addresser

* update

* paged, and i8 reflect-quant

* lets call it forward-quant

* fix error in decode variation

* update naive-attn

* fix page table

* fix build err

[ROCm/composable_kernel commit: 77a38e0211]
 2024-12-12 11:54:03 +08:00