turboderp-org/exllamav3
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav3.git synced 2026-04-20 14:29:51 +00:00
Code Issues Packages Projects Releases Wiki Activity

perf.py: Make sure test context is nontrivial to force more expert diversity

Browse Source
This commit is contained in:
turboderp
2026-03-07 01:18:27 +01:00
parent be12f3999c
commit 85cb54c6f3
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
eval/perf.py
View File

@@ -19,7 +19,7 @@ col_gray = "\u001b[37;1m"
@lru_cache
def cached_ids(length):
return torch.ones((1, length), dtype = torch.long)
return torch.arange(length, dtype = torch.long).unsqueeze(0)
def get_lengths(max_length):