theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-28 10:11:39 +00:00
Code Issues Packages Projects Releases Wiki Activity

Requirements: Update exllamav2, torch, and FA2

Browse Source 
Torch to 2.2, exllamav2 to 0.0.13, FA2 to 2.4.2 on Windows and 2.5.2
on Linux.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-02-02 22:24:44 -05:00
parent 1919bf7705
commit 6eeb62b82c
4 changed files with 20 additions and 22 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
backends/exllamav2/utils.py
View File

@@ -9,7 +9,7 @@ logger = init_logger(__name__)
def check_exllama_version():
"""Verifies the exllama version"""
required_version = "0.0.12"
required_version = "0.0.13"
current_version = package_version("exllamav2").split("+")[0]
if version.parse(current_version) < version.parse(required_version):