Bartłomiej Kocot af66494880 [CK TILE] GEMM and Batched GEMM SplitK support (#1724) ...

* [CK TILE] Add split K support in GEMM

* Updates

* Fixes

* rebase

* fix

* Fix

* fixes

* support for batched gemm

2024-12-28 14:40:17 +01:00

..

add_rmsnorm2d_rdquant

support max3 in smoothquant and add+ rmsnorm + rdquant (#1654)

2024-11-27 05:01:15 +08:00

common

[Ck tile] layernorm2d fwd optimize (#1637)

2024-11-08 12:28:23 +08:00

elementwise

[CK_TILE] fused-moe first version (#1634)

2024-11-26 11:14:56 +08:00

epilogue

[CK TILE] GEMM and Batched GEMM SplitK support (#1724)

2024-12-28 14:40:17 +01:00

flatmm/block

Enhance printing functionality (#1751)

2024-12-17 09:19:44 +01:00

fmha

[CK_TILE] Add fmha fwd N-Warp S-Shuffle pipeline (fmha fwd splitkv pipeline variant) (#1705)

2024-12-20 14:41:01 +08:00

fused_moe

[CK_TILE] optimize moe-sorting kernel (#1771)

2024-12-23 10:59:02 +08:00

gemm

[CK TILE] GEMM and Batched GEMM SplitK support (#1724)

2024-12-28 14:40:17 +01:00

image_to_column

[CK_TILE] Image to Column kernel (#1532)

2024-09-27 22:57:38 +02:00

layernorm2d

[Ck_tile] hot fix, fix rpcf param setting err (#1657)

2024-11-14 14:06:36 +08:00

permute

Remove virtual destructors from unary ops (#1610)

2024-10-30 17:42:50 +01:00

reduce/block

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

rmsnorm2d

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

smoothquant

Ck tile/smoothquant out stride (#1742)

2024-12-13 11:53:52 +08:00

softmax/block

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

topk/block

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

topk_softmax

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

welford

[Ck_tile] hot fix, fix rpcf param setting err (#1657)

2024-11-14 14:06:36 +08:00

add_rmsnorm2d_rdquant.hpp

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

common.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

elementwise.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

epilogue.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

flatmm.hpp

added moe interleaving pipeline (#1712)

2024-12-15 20:13:10 +08:00

fmha.hpp

[CK_TILE] Add fmha fwd N-Warp S-Shuffle pipeline (fmha fwd splitkv pipeline variant) (#1705)

2024-12-20 14:41:01 +08:00

fused_moe.hpp

[CK_TILE] fused-moe first version (#1634)

2024-11-26 11:14:56 +08:00

gemm.hpp

[CK_TILE] naive attn (#1708)

2024-12-12 11:54:03 +08:00

image_to_column.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

layernorm2d.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

permute.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

reduce.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

rmsnorm2d.hpp

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

smoothquant.hpp

[CK_TILE]Moe update index (#1672)

2024-11-25 13:12:35 +08:00

softmax.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

topk_softmax.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

topk.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

welford.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00