rocking5566 6a6163a3d1 Improve normalization (#580) ...

* Sync the order of type string with template parameter

* Add more instances

* Check the vector size and remove redundant var

* Extract var to static, prepare to separate sweep once kernel

* Separate sweeponce flow and optimize the flow

* 1. Rename AccDatatype in normalization to computeData
2. Rename AccElementwiseOperation to YElementwiseOperation in normalization

* Remove useless code

* Update naive variance kernel

* Refine string

* Fix typo

* Support naive variance for device_normalization

* Check the blocksize

* Share the VGPR of x and y

* Share the VGPR of gamma and beta

* Add more instances

* Support fp16 sqrt for experiment

* Add CHANGELOG

* Fix typo

* clang-format

2023-02-15 11:59:35 -06:00

..

CMakeLists.txt

layernorm external api (#379)

2022-08-24 18:43:43 -05:00

layernorm2d.cpp

Improve normalization (#580)

2023-02-15 11:59:35 -06:00