turboderp-org/exllamav3
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav3.git synced 2026-05-12 00:41:38 +00:00
Code Issues Packages Projects Releases Wiki Activity

TP: Increase reduce timeout to 45s to allow for autotune

Browse Source
This commit is contained in:
turboderp
2026-05-02 12:09:21 +02:00
parent d7eb7c3f6b
commit ca708d9064
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
exllamav3/exllamav3_ext/parallel/timeout.cuh
View File

@@ -3,7 +3,7 @@
__device__ __forceinline__ uint64_t sync_deadline()
{
return globaltimer_ns() + SYNC_TIMEOUT * 1000000000ull;
return globaltimer_ns() + SYNC_TIMEOUT * 45000000000ull;
}
__device__ __forceinline__ uint32_t check_timeout(PGContext* ctx, uint64_t deadline, const char* name)