kingbri
47582c2440
Dependencies: Update ExllamaV2
...
v0.1.0
Signed-off-by: kingbri <bdashore3@proton.me >
2024-05-25 21:16:14 -04:00
kingbri
cd78728a77
Dependencies: Update ExllamaV2
...
v0.0.21
Signed-off-by: kingbri <bdashore3@proton.me >
2024-05-11 19:26:03 -04:00
Arseniy Bakharovsky
33c86be45c
Update pyproject.toml
2024-05-08 03:31:15 +04:00
kingbri
55ccd1baad
API: Add HuggingFace downloader
...
Adds an asynchronous huggingface downloader that uses HF hub to fetch
all repo files. The current HF hub package has a snapshot_download
function that does not cancel on KeyboardInterrupt.
Instead, make a downloader that uses the Rich progress bar styling
along with a cancellable interface. Finally, link this to TabbyAPI.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-04-29 01:15:02 -04:00
kingbri
fb01b164d8
Dependencies: Update flash attention 2
...
v2.5.8
Signed-off-by: kingbri <bdashore3@proton.me >
2024-04-28 11:07:00 -04:00
kingbri
0e015ad58e
Dependencies: Update ExllamaV2
...
v0.0.20
ROCm 6.0 is now required
Signed-off-by: kingbri <bdashore3@proton.me >
2024-04-28 11:06:59 -04:00
kingbri
3de93d7c0a
Dependencies: Update torch
...
v2.3.0
NOTE: ROCm is updated to v6.0 wheels
Signed-off-by: kingbri <bdashore3@proton.me >
2024-04-28 11:06:17 -04:00
kingbri
4daa6390a5
Dependencies: Unpin lm-format-enforcer
...
It should be fine to use the stable version from now on.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-04-28 11:06:17 -04:00
kingbri
1e56d43772
Dependencies: Update lm-format-enforcer
...
v0.9.8
Signed-off-by: kingbri <bdashore3@proton.me >
2024-04-22 21:33:28 -04:00
kingbri
933c5afef0
Dependencies: Update ExllamaV2 and lm-format-enforcer
...
ExllamaV2: v0.0.19
lmfe: v0.9.6
Signed-off-by: kingbri <bdashore3@proton.me >
2024-04-19 21:15:50 -04:00
kingbri
ed05f376d9
Dependencies: Switch to LM-format-enforcer fork
...
LM format enforcer has some latency on token ingestion, so use an
optimized fork instead. Also add this in as a base dependency since
the size is small.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-04-14 11:59:49 -04:00
kingbri
30c4554572
Requirements: Update Exllamav2
...
v0.0.18
Signed-off-by: kingbri <bdashore3@proton.me >
2024-04-07 18:00:56 -04:00
kingbri
f534930270
Dependencies: Bump Exllamav2
...
v0.0.17
Signed-off-by: kingbri <bdashore3@proton.me >
2024-03-31 23:10:28 -04:00
kingbri
05b5700334
Dependencies: Update torch
...
v2.2.2
Signed-off-by: kingbri <bdashore3@proton.me >
2024-03-30 17:03:37 -04:00
kingbri
5c94894a1a
Dependencies: Update Flash Attention
...
v2.5.6
Signed-off-by: kingbri <bdashore3@proton.me >
2024-03-30 16:58:24 -04:00
kingbri
d4280e1378
Dependencies: Add pytorch-triton-rocm
...
Required for AMD installs.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-03-28 11:02:56 -04:00
kingbri
26496c4db2
Dependencies: Require tokenizers
...
This is used for some models and isn't too big in size (compared to
other huggingface dependencies), so include it by default.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-03-23 01:12:21 -04:00
kingbri
37a80334a8
Dependencies: Add packaging
...
This is a required dependency.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-03-21 11:27:27 -04:00
kingbri
345bcc30c7
Dependencies: Add extras feature
...
Installs all optional dependencies to the venv.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-03-21 00:09:38 -04:00
kingbri
7020a0a2d1
Dependencies: Update Exllamav2
...
v0.0.16
Signed-off-by: kingbri <bdashore3@proton.me >
2024-03-20 15:21:37 -04:00
kingbri
061e1d94c2
Ruff: Migrate to pyproject
...
Removes unnecessary ruff.toml.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-03-20 15:21:37 -04:00
kingbri
b1ca435695
Tree: Add pyproject.toml
...
This will manage dependencies from now on since it's a more flexible
file that's similar to other packaging utilities like npm and cargo.
Signed-off-by: kingbri <bdashore3@proton.me >
2024-03-20 15:21:37 -04:00
