carlushuang 6df5fe2ad8 [CK_TILE]naive attn support FP8 KVCache quant (#1747) ...

* quant

* fix bug

* simple smoothquant after softmax

* update kv-quant

* update stride

* fix fp8-pertoken-kvcache

* update int8/fp8 quant support

---------

Co-authored-by: so <a.com>
Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>

2025-01-03 18:43:07 +08:00

..

01_fmha

[CK_TILE]naive attn support FP8 KVCache quant (#1747)

2025-01-03 18:43:07 +08:00

02_layernorm2d

Ck tile/layernorm: implement naive reduce, opt performance (#1784)

2025-01-03 14:28:59 +08:00

03_gemm

[CK TILE] GEMM and Batched GEMM SplitK support (#1724)

2024-12-28 14:40:17 +01:00

04_img2col

[CK_TILE] Update example README files & fix script compatibility issue (#1548)

2024-10-08 10:45:12 +08:00

05_reduce

[Ck tile] support rmsnorm and related fusion (#1605)

2024-10-30 15:22:56 +08:00

06_permute

[CK_TILE] fused-moe first version (#1634)

2024-11-26 11:14:56 +08:00

09_topk_softmax

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

10_rmsnorm2d

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

11_add_rmsnorm2d_rdquant

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

12_smoothquant

Ck tile/smoothquant out stride (#1742)

2024-12-13 11:53:52 +08:00

13_moe_sorting

[CK_TILE] optimize moe-sorting kernel (#1771)

2024-12-23 10:59:02 +08:00

14_moe_smoothquant

[CK_TILE]Moe update index (#1672)

2024-11-25 13:12:35 +08:00

15_fused_moe

[CK_TILE] optimize moe-sorting kernel (#1771)

2024-12-23 10:59:02 +08:00

16_batched_gemm

[CK TILE] GEMM and Batched GEMM SplitK support (#1724)

2024-12-28 14:40:17 +01:00

17_grouped_gemm

Apply Ck-tile argument parser for vectors [I/O] (#1758)

2024-12-19 17:55:35 +01:00

CMakeLists.txt

Ck tile grouped GEMM example (#1713)

2024-12-04 21:40:01 +01:00

remod.py

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00