mirror of
https://github.com/theroyallab/tabbyAPI.git
synced 2026-03-15 00:07:28 +00:00
Requirements: Add sse-starlette
Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
@@ -14,3 +14,4 @@ rich
|
||||
uvicorn
|
||||
jinja2 >= 3.0.0
|
||||
loguru
|
||||
sse-starlette
|
||||
|
||||
@@ -20,6 +20,7 @@ rich
|
||||
uvicorn
|
||||
jinja2 >= 3.0.0
|
||||
loguru
|
||||
sse-starlette
|
||||
|
||||
# Linux FA2 from https://github.com/Dao-AILab/flash-attention/releases
|
||||
https://github.com/Dao-AILab/flash-attention/releases/download/v2.5.2/flash_attn-2.5.2+cu118torch2.2cxx11abiFALSE-cp311-cp311-linux_x86_64.whl; platform_system == "Linux" and platform_machine == "x86_64" and python_version == "3.11"
|
||||
|
||||
@@ -6,3 +6,4 @@ rich
|
||||
uvicorn
|
||||
jinja2 >= 3.0.0
|
||||
loguru
|
||||
sse-starlette
|
||||
|
||||
@@ -20,6 +20,7 @@ rich
|
||||
uvicorn
|
||||
jinja2 >= 3.0.0
|
||||
loguru
|
||||
sse-starlette
|
||||
|
||||
# Flash attention v2
|
||||
|
||||
|
||||
Reference in New Issue
Block a user