Make comment more clear

This commit is contained in:
PoYen, Chen
2024-08-20 14:10:16 +00:00
parent 8745f5f8bb
commit 3850028bca

View File

@@ -150,7 +150,7 @@ decode_seqlen(mode_enum mode,
if(1 < batch && use_kvcache)
{
// we always use seqlen_k_max in first batch
// to keep the original s_k value, we always use seqlen_k_max in first batch
randints(std::next(seqlen_ks.begin()),
seqlen_ks.end(),
seqlen_k_min,