AMD-dteng d5c8a334ca enable bias feature that add bias before adding residual (for rtpllm project) (#1741) ...

* 1. enable bias feature that add bias before adding residual; 2. change block size from 128->64 when m<64 in fp16

* delete comment

* 1.remove fmha change 2.change buffer name from bias to xbias

* Now bias can be used independently from fadd

* change kbias to kxbias

---------

Co-authored-by: feli <felix.li@amd.com>

2025-01-08 17:51:06 +08:00

..

layernorm2d_fwd_kernel.hpp

enable bias feature that add bias before adding residual (for rtpllm project) (#1741)

2025-01-08 17:51:06 +08:00