Po Yen Chen fb1ccfa9df [CK_TILE] Add paged-kvcache support in group mode fmha fwd splitkv kernels (#1678) ...

* Generate group mode paged-attn kernel

* Enable paged-kvcache + group mode support

* Add missing header: fused_moe.hpp

* Add comment to explain kernel arg usage

* Make error message more clear

* Add comment for confusing data member names

* Add more comment for confusing variable names

* Fix typo in option description

2024-11-21 14:53:10 +08:00

..

01_fmha

[CK_TILE] Add paged-kvcache support in group mode fmha fwd splitkv kernels (#1678)

2024-11-21 14:53:10 +08:00

02_layernorm2d

[CK_TILE] add more stride for layernorm to support un-continuous Tensor (#1650)

2024-11-11 16:02:28 +08:00

03_gemm

[CK Tile] Improve the Layout, Padding, and Alignment features of CK Tile GEMM (#1651)

2024-11-11 18:08:25 -08:00

04_img2col

[CK_TILE] Update example README files & fix script compatibility issue (#1548)

2024-10-08 10:45:12 +08:00

05_reduce

[Ck tile] support rmsnorm and related fusion (#1605)

2024-10-30 15:22:56 +08:00

06_permute

[CK_TILE] add generic_permute (#1607)

2024-10-29 18:05:53 +08:00

09_topk_softmax

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

10_rmsnorm2d

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

11_add_rmsnorm2d_rdquant

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

12_smoothquant

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

13_moe_sorting

Ck tile/moe sorting (#1624)

2024-11-09 17:57:27 +08:00

CMakeLists.txt

Ck tile/moe sorting (#1624)

2024-11-09 17:57:27 +08:00

remod.py

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00