mirror of
https://github.com/theroyallab/tabbyAPI.git
synced 2026-03-14 15:57:27 +00:00
47176a2a1e
Use --extra-index-url to install pytorch. This should be secure enough since dependency confusion attacks aren't possible with just installing the torch package. Signed-off-by: kingbri <bdashore3@proton.me>
15 lines
394 B
Plaintext
15 lines
394 B
Plaintext
# Torch
|
|
--extra-index-url https://download.pytorch.org/whl/rocm5.6
|
|
torch
|
|
|
|
# Exllamav2
|
|
https://github.com/turboderp/exllamav2/releases/download/v0.0.10/exllamav2-0.0.10+rocm5.6-cp311-cp311-linux_x86_64.whl
|
|
https://github.com/turboderp/exllamav2/releases/download/v0.0.10/exllamav2-0.0.10+rocm5.6-cp310-cp310-linux_x86_64.whl
|
|
|
|
# Pip dependencies
|
|
fastapi
|
|
pydantic < 2,>= 1
|
|
PyYAML
|
|
progress
|
|
uvicorn
|