theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Model: Fix log if exl2 version is too low

Browse Source 
Switch to pyproject syntax.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-03-31 23:11:21 -04:00
parent f534930270
commit 6ecce1604b
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
backends/exllamav2/utils.py
View File

@@ -18,11 +18,11 @@ def check_exllama_version():
"Or you can manually run a requirements update "
"using the following command:\n\n"
"For CUDA 12.1:\n"
"pip install --upgrade -r requirements.txt\n\n"
"pip install --upgrade .[cu121]\n\n"
"For CUDA 11.8:\n"
"pip install --upgrade -r requirements-cu118.txt\n\n"
"pip install --upgrade .[cu118]\n\n"
"For ROCm:\n"
"pip install --upgrade -r requirements-amd.txt\n\n"
"pip install --upgrade .[amd]\n\n"
)
else:
logger.info(f"ExllamaV2 version: {current_version}")