ruanjm d49abdaa87 [CK_TILE] Improve RMS/Layer Normalization 2 Pass Pipeline Performance (#1861) ...

* 50ms -> 28ms

* Fix bug in non fuse_add_store cases

* Fine tuned setting for 2 pass pipeline

* adjust workload

* remove unnecessary change

* add layernorm

* Adding output quant and unquant results at the same time.

* fix test

* fix format

* tune for cases 128x640 and 128x1024

* bug ifx

2025-03-25 20:09:45 +08:00

..

reference_batched_dropout.hpp

CK Tile FA Training kernels (#1286)

2024-06-04 13:12:45 -05:00

reference_batched_elementwise.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

reference_batched_gemm.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

reference_batched_masking.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

reference_batched_rotary_position_embedding.hpp

[CK_TILE] Add PagedAttention kernels (#1387)

2024-08-28 20:50:43 +08:00

reference_batched_softmax.hpp

introducing ck_tile! (#1216)

2024-04-15 19:27:12 -05:00

reference_batched_transpose.hpp

add batched_transpose implement (#1660)

2025-01-28 16:22:02 -08:00

reference_elementwise.hpp

Remove virtual destructors from unary ops (#1610)

2024-10-30 17:42:50 +01:00

reference_fused_moe.hpp

[CK_TILE] Fix mock token id, support g1u1/g1u0 through same inline code block (#1808)

2025-01-16 17:51:10 +08:00

reference_gemm.hpp

[CK TILE] GEMM with packed i4 (#1885)

2025-02-20 09:59:49 +01:00

reference_im2col.hpp

[CK_TILE] Image to Column kernel (#1532)

2024-09-27 22:57:38 +02:00

reference_layernorm2d_fwd.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

reference_moe_sorting.hpp

[CK_TILE] moe sorting ex kernel to support expert > 128 (#1840)

2025-02-11 17:49:17 +08:00

reference_permute.hpp

[CK_TILE] fused-moe first version (#1634)

2024-11-26 11:14:56 +08:00

reference_reduce.hpp

[Ck tile] support rmsnorm and related fusion (#1605)

2024-10-30 15:22:56 +08:00

reference_rmsnorm2d_fwd.hpp

[CK_TILE] Improve RMS/Layer Normalization 2 Pass Pipeline Performance (#1861)

2025-03-25 20:09:45 +08:00

reference_rowwise_quantization2d.hpp

add fp8 as dst (#1830)

2025-01-22 17:34:27 +08:00

reference_softmax.hpp

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

reference_topk.hpp

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00