kvcache-ai/sglang
1
0
Fork 0
mirror of https://github.com/kvcache-ai/sglang.git synced 2026-07-09 00:37:44 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix idle batch predict dtype in spec v2 (#18379)

Browse Source
This commit is contained in:
Qiaolin Yu
2026-02-09 18:29:13 -08:00
committed by GitHub
parent df733c5ee5
commit 4a1b50bb2d
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/srt/speculative/eagle_info_v2.py
View File

@@ -267,7 +267,7 @@ class EagleVerifyInputV2Mixin:
(which contains spec decoding information).
"""
if batch.forward_mode.is_idle():
predict = torch.empty(0, dtype=torch.long, device=batch.input_ids.device)
predict = torch.empty(0, dtype=torch.int32, device=batch.input_ids.device)
accept_length = torch.empty(
0, dtype=torch.int32, device=batch.input_ids.device
)