ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-05-19 12:30:16 +00:00
Code Issues Packages Projects Releases Wiki Activity

Use exp2() to calculate exp() for better performance

Browse Source
This commit is contained in:
Qianfeng Zhang
2025-04-16 06:54:06 +00:00
parent 226a254723
commit 1351d9cd1b
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
example/ck_tile/18_hstu_attention/hstu_attention_fwd_pipeline.hpp
View File

@@ -251,7 +251,7 @@ struct HstuAttentionFwdPipelineQRKSVS
const auto f_silu = [](CompDataType& x) {
const auto one = ck_tile::type_convert<CompDataType>(1.0f);
return x = x / (one + exp(-x));
return x = x / (one + exp2(-log2e_v<CompDataType> * x));
};
using OaccBlockTileType = decltype(gemm_1.MakeCBlockTile());