wen-des a115ab14ed group mode attetnion for generic 64<hd<=128 (#2092) ...

* group mode attetnion for generic 64<hd<=128

* fix loop_idx overridden before kvBase in causal mode

* align format

---------

Co-authored-by: Wen.Yang <Wen.Yang@example.com>
Co-authored-by: danyao12 <danyao12@amd.com>

2025-04-20 11:11:11 +08:00

..

01_fmha

group mode attetnion for generic 64<hd<=128 (#2092)

2025-04-20 11:11:11 +08:00

02_layernorm2d

Implement fp8 quant for layernorm and rmsnorm (#1814)

2025-01-24 16:40:43 +08:00

03_gemm

fix ck_tile/basic_gemm build error (#1988)

2025-03-20 22:01:14 -07:00

04_img2col

[CK_TILE] Update example README files & fix script compatibility issue (#1548)

2024-10-08 10:45:12 +08:00

05_reduce

[CK_TILE] Adjust kBlockSize of reduce example for better perf (#1779)

2025-01-12 20:50:32 -08:00

06_permute

[CK_TILE] fused-moe first version (#1634)

2024-11-26 11:14:56 +08:00

09_topk_softmax

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

10_rmsnorm2d

Implement fp8 quant for layernorm and rmsnorm (#1814)

2025-01-24 16:40:43 +08:00

11_add_rmsnorm2d_rdquant

[A8W8 GEMM] Optimized weight-preshuffled implementation & add quantization datatype for CK TILE rms_norm (#1862)

2025-02-20 14:00:27 -08:00

12_smoothquant

[CK_TILE] Add Various Fusion Functions to RMSNorm (#1802)

2025-01-15 10:23:48 +08:00

13_moe_sorting

[CK_TILE] add moe-sorting MP kernel (#1910)

2025-02-25 17:56:55 +08:00

14_moe_smoothquant

add fp8 as dst (#1830)

2025-01-22 17:34:27 +08:00

15_fused_moe

[CK_TILE] return value with macro in ck_tile::kernel_launch API (#1982)

2025-03-20 11:00:29 -07:00

16_batched_gemm

[CK_TILE] Switch to universal gemm for batched and grouped gemms (#1919)

2025-03-20 11:17:04 +01:00

17_grouped_gemm

[CK_TILE] Switch to universal gemm for batched and grouped gemms (#1919)

2025-03-20 11:17:04 +01:00

35_batched_transpose

add batched_transpose implement (#1660)

2025-01-28 16:22:02 -08:00

CMakeLists.txt

add batched_transpose implement (#1660)

2025-01-28 16:22:02 -08:00

remod.py

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00