zanzhang 299c63d198 fix moe gemm for not gate only

2025-05-22 13:12:15 +08:00

..

add_rmsnorm2d_rdquant

[A8W8 GEMM] Optimized weight-preshuffled implementation & add quantization datatype for CK TILE rms_norm (#1862)

2025-02-20 14:00:27 -08:00

batched_transpose

Vectorized Transpose for Batched Transpose CK Tile Operator (#2131)

2025-05-12 00:41:45 -07:00

common

fix ck_tile/basic_gemm build error (#1988)

2025-03-20 22:01:14 -07:00

elementwise

[CK TILE] GEMM with packed i4 (#1885)

2025-02-20 09:59:49 +01:00

epilogue

Merge branch 'develop' into zan/cK_tile/moe_gemm

2025-05-21 14:19:00 +08:00

flatmm

fix moe gemm for not gate only

2025-05-22 13:12:15 +08:00

fmha

Merge branch 'develop' into zan/cK_tile/moe_gemm

2025-05-21 14:19:00 +08:00

fused_moe

[CK_TILE] optimize moe sorting kernel, boost large context case up to 20x (#2153)

2025-05-06 17:32:07 +08:00

gemm

Merge branch 'develop' into zan/cK_tile/moe_gemm

2025-05-21 14:19:00 +08:00

image_to_column

[CK_TILE] Image to Column kernel (#1532)

2024-09-27 22:57:38 +02:00

layernorm2d

[CK_TILE] Improve RMS/Layer Normalization 2 Pass Pipeline Performance (#1861)

2025-03-25 20:09:45 +08:00

moe_gemm

fix moe gemm for not gate only

2025-05-22 13:12:15 +08:00

norm_reduce

Ck tile/layernorm: implement naive reduce, opt performance (#1784)

2025-01-03 14:28:59 +08:00

permute

Remove virtual destructors from unary ops (#1610)

2024-10-30 17:42:50 +01:00

reduce/block

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

rmsnorm2d

[CK_TILE] Improve RMS/Layer Normalization 2 Pass Pipeline Performance (#1861)

2025-03-25 20:09:45 +08:00

smoothquant

add fp8 as dst (#1830)

2025-01-22 17:34:27 +08:00

softmax/block

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

topk/block

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

topk_softmax

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

add_rmsnorm2d_rdquant.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

batched_transpose.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

common.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

elementwise.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

epilogue.hpp

Solve the Static Encoding Pattern compile error when the tile size is too small (#2079)

2025-04-13 20:09:30 -07:00

flatmm.hpp

[flatmm] implement basic fp16 flatmm (#2089)

2025-04-16 16:51:17 +08:00

fmha.hpp

[CK_TILE] Add logits soft-capping & customization support to the FMHA forward kernel/pipelines (#2163)

2025-05-13 12:19:25 +08:00

fused_moe.hpp

[CK_TILE] moe sorting ex kernel to support expert > 128 (#1840)

2025-02-11 17:49:17 +08:00

gemm.hpp

moe-gemm change into flatmm & tile_window modify to tile_scatter_gather

2025-04-27 17:53:42 +08:00

image_to_column.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

layernorm2d.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

moe_gemm.hpp

add activation and gate-up

2025-04-28 09:52:56 +08:00

norm_reduce.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

permute.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

reduce.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

rmsnorm2d.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

smoothquant.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

softmax.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

topk_softmax.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00

topk.hpp

[CK_TILE] Add GetName for GEMM kernels (#1791)

2025-02-11 09:49:48 +01:00