theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-28 18:21:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

Requirements: Split for configurations

Browse Source 
Add self-contained requirements for cuda 11.8 and ROCm

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2023-12-06 00:00:30 -05:00
parent 4c0e686e7d
commit b83e1b704e
5 changed files with 88 additions and 48 deletions
Download Patch File Download Diff File Expand all files Collapse all files

13
requirements-amd.txt Normal file
View File

@@ -0,0 +1,13 @@
# Torch
torch --index-url https://download.pytorch.org/whl/rocm5.6
# Exllamav2
https://github.com/turboderp/exllamav2/releases/download/v0.0.10/exllamav2-0.0.10+rocm5.6-cp311-cp311-linux_x86_64.whl
https://github.com/turboderp/exllamav2/releases/download/v0.0.10/exllamav2-0.0.10+rocm5.6-cp310-cp310-linux_x86_64.whl
# Pip dependencies
fastapi
pydantic < 2,>= 1
PyYAML
progress
uvicorn