turboderp-org/exllamav3
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav3.git synced 2026-04-20 14:29:51 +00:00
Code Issues Packages Projects Releases Wiki Activity

compare_q.py: Work around AutoAWQ being broken in later versions of Transformers

Browse Source
This commit is contained in:
turboderp
2025-11-09 13:33:40 +01:00
parent ff89563719
commit 3562dbe7b0
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
eval/compare_q_transformers.py
View File

@@ -19,6 +19,8 @@ try:
from awq.modules.linear import WQLinear_GEMM
except ModuleNotFoundError:
WQLinear_GEMM = None
except ImportError:
WQLinear_GEMM = None
try:
from vptq import VQuantLinear