ROCm/composable_kernel
1
0
Fork 0
mirror of https://github.com/ROCm/composable_kernel.git synced 2026-06-06 15:54:31 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add constraint to the rotary_dim option

Browse Source
This commit is contained in:
PoYen, Chen
2024-07-16 06:54:37 +00:00
parent 99f863e4cd
commit e83c3c7fa0
1 changed files with 5 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
example/ck_tile/01_fmha/fmha_fwd.cpp
View File

@@ -400,6 +400,11 @@ bool run(const ck_tile::ArgParser& arg_parser)
std::cerr << "rotary_dim should be less than or equal to head dim for q" << std::endl;
return false;
}
else if(!(rotary_dim % 8 == 0))
{
std::cerr << "only rotary dimensions divisible by 8 are currently supported" << std::endl;
return false;
}
const bool is_rotary_interleaved = arg_parser.get_bool("rotary_interleaved");