dummycoderfe 686a58a912 [Ck tile] layernorm2d fwd optimize (#1637) ...

* optimze small N case using vec io and using rcp div

* [Ck_tile] layernorm, add param to control fastdiv; change generate codes and test pass

* [Ck_tile] fix blockSize compute in Generic2dBlockShape

* [Ck_tile]fix kfastfdiv template style

* [Ck_tile] layernorm, fix stype in review

---------

Co-authored-by: dummycoderfe <noplydummmycoder@163.com>

2024-11-08 12:28:23 +08:00

..

add_rmsnorm2d_rdquant

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

common

[Ck tile] layernorm2d fwd optimize (#1637)

2024-11-08 12:28:23 +08:00

elementwise

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

epilogue

[CK_TILE] layernorm have more accurate residual (#1623)

2024-11-02 13:30:16 +08:00

fmha

Remove virtual destructors from unary ops (#1610)

2024-10-30 17:42:50 +01:00

gemm

[CK-Tile] Universal gemm memory bound pipeline (#1558)

2024-10-30 10:05:15 +01:00

image_to_column

[CK_TILE] Image to Column kernel (#1532)

2024-09-27 22:57:38 +02:00

layernorm2d

[Ck tile] layernorm2d fwd optimize (#1637)

2024-11-08 12:28:23 +08:00

permute

Remove virtual destructors from unary ops (#1610)

2024-10-30 17:42:50 +01:00

reduce/block

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

rmsnorm2d

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

smoothquant

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

softmax/block

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

topk/block

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

topk_softmax

topk_softmax (#1592)

2024-10-26 23:52:49 +08:00

welford

[Ck tile] layernorm2d fwd optimize (#1637)

2024-11-08 12:28:23 +08:00

add_rmsnorm2d_rdquant.hpp

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

common.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

elementwise.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

epilogue.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

fmha.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

gemm.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

image_to_column.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

layernorm2d.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

permute.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

reduce.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

rmsnorm2d.hpp

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

smoothquant.hpp

[Ck_tile] smoothquant (#1617)

2024-11-01 13:51:56 +08:00

softmax.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

topk_softmax.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

topk.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00

welford.hpp

[CK_TILE] layernorm support fused-quant/fused-add (#1604)

2024-10-31 14:54:53 +08:00