Commit Graph

7 Commits

Author SHA1 Message Date
kingbri
da69ad8cd3 Requirements: Pin versions for some dependencies
Pydantic and Jinja2 need pinned versions.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-12-19 21:48:04 -05:00
kingbri
51ca1ff396 Tree: Switch to Pydantic 2
Pydantic 2 has more modern methods and stability compared to Pydantic 1

Signed-off-by: kingbri <bdashore3@proton.me>
2023-12-18 23:53:47 -05:00
kingbri
f631dd6ff7 Templates: Switch to Jinja2
Jinja2 is a lightweight template parser that's used in Transformers
for parsing chat completions. It's much more efficient than Fastchat
and can be imported as part of requirements.

Also allows for unblocking Pydantic's version.

Users now have to provide their own template if needed. A separate
repo may be usable for common prompt template storage.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-12-18 23:53:47 -05:00
kingbri
528d58f841 Requirements: Fix AMD
Signed-off-by: kingbri <bdashore3@proton.me>
2023-12-17 00:45:43 -05:00
kingbri
f196f1177d Requirements: Update exllamav2 to 0.0.11
Signed-off-by: kingbri <bdashore3@proton.me>
2023-12-16 19:33:42 -05:00
kingbri
47176a2a1e Requirements: Fix torch install
Use --extra-index-url to install pytorch. This should be secure enough
since dependency confusion attacks aren't possible with just installing
the torch package.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-12-06 19:04:35 -05:00
kingbri
b83e1b704e Requirements: Split for configurations
Add self-contained requirements for cuda 11.8 and ROCm

Signed-off-by: kingbri <bdashore3@proton.me>
2023-12-06 00:00:30 -05:00