Adam Osewski ce448002ee [CK Tile] Spatially local GEMM tile partitioner. (#1843) ...

* Add spatially local tile partitioner

* Use 1D Grid size & create partitioner object.

* Docs & use 1D partitioner in example.

* Clang format.

* Change kernel grid size

Now: X is the # of output C-tiles,
     Y is the batch count
     Z is the splitK

* Formatting & more doc.

* Clang format.

* Fix batched gemm test. Use 1d partitioner.

* Move condition.

* FIx ctor.

* clang-format.

2025-01-31 00:10:16 +01:00

..

add_rmsnorm2d_rdquant

support max3 in smoothquant and add+ rmsnorm + rdquant (#1654)

2024-11-27 05:01:15 +08:00

batched_transpose

add batched_transpose implement (#1660)

2025-01-28 16:22:02 -08:00

common

[Ck tile] layernorm2d fwd optimize (#1637)

2024-11-08 12:28:23 +08:00

elementwise

[CK_TILE] Fix mock token id, support g1u1/g1u0 through same inline code block (#1808)

2025-01-16 17:51:10 +08:00

epilogue

[CK TILE] Implement cschuflle algorithm (#1842)

2025-01-30 11:57:39 +01:00

flatmm/block

[CK_TILE] Fix mock token id, support g1u1/g1u0 through same inline code block (#1808)

2025-01-16 17:51:10 +08:00

fmha

Update for fmha_fwd qs_ks_vs pipeline (#1810)

2025-01-13 12:43:05 +08:00

fused_moe

[CK_TILE] Fix mock token id, support g1u1/g1u0 through same inline code block (#1808)

2025-01-16 17:51:10 +08:00

gemm

[CK Tile] Spatially local GEMM tile partitioner. (#1843)

2025-01-31 00:10:16 +01:00

image_to_column

[CK_TILE] Image to Column kernel (#1532)

2024-09-27 22:57:38 +02:00

layernorm2d

[CK_TILE] Add Various Fusion Functions to RMSNorm (#1802)

2025-01-15 10:23:48 +08:00

norm_reduce

Ck tile/layernorm: implement naive reduce, opt performance (#1784)

2025-01-03 14:28:59 +08:00

permute

Remove virtual destructors from unary ops (#1610)

2024-10-30 17:42:50 +01:00

reduce/block

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

rmsnorm2d

[CK_TILE] Add Various Fusion Functions to RMSNorm (#1802)

2025-01-15 10:23:48 +08:00

smoothquant

add fp8 as dst (#1830)

2025-01-22 17:34:27 +08:00

softmax/block

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

topk/block

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

topk_softmax

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

add_rmsnorm2d_rdquant.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

batched_transpose.hpp

add batched_transpose implement (#1660)

2025-01-28 16:22:02 -08:00

common.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

elementwise.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

epilogue.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

flatmm.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

fmha.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

fused_moe.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

gemm.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

image_to_column.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

layernorm2d.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

norm_reduce.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

permute.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

reduce.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

rmsnorm2d.hpp

[CK_TILE] Add Various Fusion Functions to RMSNorm (#1802)

2025-01-15 10:23:48 +08:00

smoothquant.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

softmax.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

topk_softmax.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00

topk.hpp

[CK_TILE] fmha fwd splitkv optimization for decode (seqlen_q=1) (#1789)

2025-01-07 18:49:24 +08:00