carlushuang 74b0db75f7 [CK_TILE] fused-moe first version (#1634) ...

* moe pipeline

* update code

* compile OK

* update

* update cpu reference

* update pipeline_gemm0

* compiler ok

* update pipeline

* rename to ex pipeline

* block-asm

* update

* update

* update first gemm ok

* compute correct

* update file structure

* update README

* update

* update

* update code

* update API

* return unsupport case

* add comment

* update readme

* update

* uncomment

* update

* fix build err

---------

Co-authored-by: valarLip <340077269@qq.com>

[ROCm/composable_kernel commit: 440e28b08f]

2024-11-26 11:14:56 +08:00

..

reference_batched_dropout.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

reference_batched_elementwise.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

reference_batched_gemm.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

reference_batched_masking.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

reference_batched_rotary_position_embedding.hpp

[CK_TILE] Add PagedAttention kernels (#1387)

2024-08-28 20:50:43 +08:00

reference_batched_softmax.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

reference_elementwise.hpp

Remove virtual destructors from unary ops (#1610)

2024-10-30 17:42:50 +01:00

reference_fused_moe.hpp

[CK_TILE] fused-moe first version (#1634)

2024-11-26 11:14:56 +08:00

reference_gemm.hpp

[CK-Tile] Universal gemm memory bound pipeline (#1558)

2024-10-30 10:05:15 +01:00

reference_im2col.hpp

[CK_TILE] Image to Column kernel (#1532)

2024-09-27 22:57:38 +02:00

reference_layernorm2d_fwd.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

reference_moe_sorting.hpp

[CK_TILE]Moe update index (#1672)

2024-11-25 13:12:35 +08:00

reference_permute.hpp

[CK_TILE] fused-moe first version (#1634)

2024-11-26 11:14:56 +08:00

reference_reduce.hpp

[Ck tile] support rmsnorm and related fusion (#1605)

2024-10-30 15:22:56 +08:00

reference_rmsnorm2d_fwd.hpp

Remove virtual destructors from unary ops (#1610)

2024-10-30 17:42:50 +01:00

reference_rowwise_quantization2d.hpp

[Ck tile] support rmsnorm and related fusion (#1605)

2024-10-30 15:22:56 +08:00

reference_softmax.hpp

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

reference_topk.hpp

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00