theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-30 19:21:34 +00:00
Code Issues Packages Projects Releases Wiki Activity

Requirements: Update exllamav2, torch, and FA2

Browse Source 
Torch to 2.2, exllamav2 to 0.0.13, FA2 to 2.4.2 on Windows and 2.5.2
on Linux.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-02-02 22:24:44 -05:00
parent 1919bf7705
commit 6eeb62b82c
4 changed files with 20 additions and 22 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
requirements-amd.txt
View File

@@ -1,11 +1,10 @@
# Torch
# Patch until torch 2.2 is supported
--extra-index-url https://download.pytorch.org/whl/rocm5.6
torch < 2.2, >= 2
torch ~= 2.2
# Exllamav2
https://github.com/turboderp/exllamav2/releases/download/v0.0.12/exllamav2-0.0.12+rocm5.6-cp311-cp311-linux_x86_64.whl; python_version == "3.11"
https://github.com/turboderp/exllamav2/releases/download/v0.0.12/exllamav2-0.0.12+rocm5.6-cp310-cp310-linux_x86_64.whl; python_version == "3.10"
https://github.com/turboderp/exllamav2/releases/download/v0.0.13/exllamav2-0.0.13+rocm5.6-cp311-cp311-linux_x86_64.whl; python_version == "3.11"
https://github.com/turboderp/exllamav2/releases/download/v0.0.13/exllamav2-0.0.13+rocm5.6-cp310-cp310-linux_x86_64.whl; python_version == "3.10"
# Pip dependencies
fastapi