Adam Osewski ce448002ee [CK Tile] Spatially local GEMM tile partitioner. (#1843) ...

* Add spatially local tile partitioner

* Use 1D Grid size & create partitioner object.

* Docs & use 1D partitioner in example.

* Clang format.

* Change kernel grid size

Now: X is the # of output C-tiles,
     Y is the batch count
     Z is the splitK

* Formatting & more doc.

* Clang format.

* Fix batched gemm test. Use 1d partitioner.

* Move condition.

* FIx ctor.

* clang-format.

2025-01-31 00:10:16 +01:00

..

01_fmha

Add OCP FP8 support in CK_TILE (#1829)

2025-01-27 11:59:49 -07:00

02_layernorm2d

Implement fp8 quant for layernorm and rmsnorm (#1814)

2025-01-24 16:40:43 +08:00

03_gemm

[CK Tile] Spatially local GEMM tile partitioner. (#1843)

2025-01-31 00:10:16 +01:00

04_img2col

[CK_TILE] Update example README files & fix script compatibility issue (#1548)

2024-10-08 10:45:12 +08:00

05_reduce

[CK_TILE] Adjust kBlockSize of reduce example for better perf (#1779)

2025-01-12 20:50:32 -08:00

06_permute

[CK_TILE] fused-moe first version (#1634)

2024-11-26 11:14:56 +08:00

09_topk_softmax

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

10_rmsnorm2d

Implement fp8 quant for layernorm and rmsnorm (#1814)

2025-01-24 16:40:43 +08:00

11_add_rmsnorm2d_rdquant

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

12_smoothquant

[CK_TILE] Add Various Fusion Functions to RMSNorm (#1802)

2025-01-15 10:23:48 +08:00

13_moe_sorting

[CK_TILE] optimize moe-sorting kernel (#1771)

2024-12-23 10:59:02 +08:00

14_moe_smoothquant

add fp8 as dst (#1830)

2025-01-22 17:34:27 +08:00

15_fused_moe

[CK_TILE] Fix mock token id, support g1u1/g1u0 through same inline code block (#1808)

2025-01-16 17:51:10 +08:00

16_batched_gemm

[CK Tile] Spatially local GEMM tile partitioner. (#1843)

2025-01-31 00:10:16 +01:00

17_grouped_gemm

[CK TILE] Implement cschuflle algorithm (#1842)

2025-01-30 11:57:39 +01:00

35_batched_transpose

add batched_transpose implement (#1660)

2025-01-28 16:22:02 -08:00

CMakeLists.txt

add batched_transpose implement (#1660)

2025-01-28 16:22:02 -08:00

remod.py

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00