Commit Graph

237 Commits

Author SHA1 Message Date
majick
dea4254e01 Fix: inverted sense bug with cuda sd float32
Inverting the use of float16 with SD on cuda was introduced with my MPS
hack.  Fixed.
Also, make the MPS changes more consistent with cuda_device, since we
don't need a hardcoded value any more.
2023-06-28 14:19:59 -07:00
majick
aee5e71e45 First pass at Apple Silicon MPS back end 2023-06-28 11:11:38 -07:00
SillyLossy
5b8d9e2c92 [Feature request] Specify which GPU to use if CUDA is selected as a command line argument. #65 2023-06-26 11:24:05 +03:00
SillyLossy
24ea1e8a19 Lint spaces 2023-06-25 21:02:29 +03:00
Cohee
abc8cab76c Merge pull request #64 from BlipRanger/main
Initial work on multichat chroma
2023-06-25 20:51:58 +03:00
BlipRanger
5b4753b719 Respect requested query number 2023-06-25 01:01:03 -04:00
BlipRanger
7b733e7498 Initial work on multichat chroma 2023-06-24 14:49:08 -04:00
SillyLossy
ff0e9a0ba3 Merge branch 'main' of https://github.com/Cohee1207/SillyTavern-extras 2023-06-24 21:32:08 +03:00
SillyLossy
01d6c9a431 Add ignore of tts samples to API key 2023-06-24 21:31:49 +03:00
SillyLossy
6386caabec Fix CUDA mode. 2023-06-22 12:15:31 +03:00
Cohee
e6badf2f8a Merge pull request #60 from johnbenac/main 2023-06-22 08:49:52 +03:00
johnbenac
add7daa61b sorts messages in ChromaDB export by 'date' order 2023-06-22 00:25:53 -04:00
SillyLossy
db0b232903 Extra modules (except SD) now use CPU by default 2023-06-18 21:51:31 +03:00
Cohee
94ab92972c Merge pull request #58 from BlipRanger/main
Optionality for Chromadb persistence
2023-06-18 21:37:30 +03:00
BlipRanger
13628591e9 Line removal 2023-06-17 20:53:03 -04:00
BlipRanger
7d5582584e Make chromadb persistence optional
Allows for the use of the `--chroma-persist` and `--no-chroma-persist` args. Still defaults to true.
2023-06-17 20:51:42 -04:00
SillyLossy
d146ad5bc6 Merge branch 'main' of http://github.com/Cohee1207/SillyTavern-extras 2023-06-13 13:56:11 +03:00
SillyLossy
453e850d41 Remove outdated modules from readme 2023-06-13 13:55:59 +03:00
Cohee
09863be665 Update README.md 2023-06-13 01:05:56 +03:00
Cohee
87d4960b54 Merge pull request #54 from bucketcat/main
Update README.md to include a link to the documentation.
2023-06-13 01:05:07 +03:00
bucketcat
1d499ce071 Update README.md 2023-06-12 16:57:58 +00:00
SillyLossy
eb7c4b68ff #53 Fix buffering of SD output image 2023-06-11 13:42:30 +03:00
SillyLossy
bb0ae04976 Add rate to Edge TTS 2023-06-10 15:37:37 +03:00
Cohee
3e349df526 Update README.md 2023-06-09 18:45:37 +03:00
SillyLossy
34b1b3afda Add response compression 2023-06-04 15:00:13 +03:00
SillyLossy
c9e1ced4f2 Add editorconfig 2023-06-04 12:40:36 +03:00
SillyLossy
a707dd02ff [Feature] Edge Text to speech #34 2023-06-04 12:38:36 +03:00
SillyLossy
a0000347e9 Remove unused modules 2023-06-04 01:58:49 +03:00
SillyLossy
befdc746c5 Remote ChromaDB REST api errors #42 2023-06-04 01:37:33 +03:00
Cohee
0f21d004d2 Merge pull request #44 from bdashore3/main 2023-06-03 13:39:12 +03:00
kingbri
8381305f70 Server: Add API key for security
When the extras server was hosted publicly, there was a huge security
risk of anyone finding a cloudflare tunnel URL and directly querying
API routes.

However, this had a simple solution of implementing middleware to check
if a generated API key is valid. Since the server is simple, the API
key is a string of bytes stored in a textfile. If that textfile is
deleted, extras will automatically create a new API key/textfile.

Additionally, this is enabled via an optional argument to prevent
local user irritation.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-06-02 22:26:54 -04:00
SillyLossy
1490dfe965 Add chroma to gitignore 2023-06-02 21:24:46 +03:00
Cohee
889137f9e8 Merge pull request #41 from BlipRanger/main
Add persistence to chromadb
2023-05-31 01:34:42 +03:00
BlipRanger
bf59b363ca Add persistence to chromadb
Saves chromadb to specified persistence folder (with default being .chroma_db). Purge correctly purges persistence folder.
2023-05-30 18:14:00 -04:00
Cohee
f011989b25 Update README.md 2023-05-30 23:09:24 +03:00
Cohee
6a65169109 Update README.md 2023-05-30 23:08:13 +03:00
Cohee
6ec01e8b48 Merge pull request #39 from bdashore3/main
Add support for ChromaDB instances on the local network
2023-05-30 20:39:51 +03:00
kingbri
6f94638f76 Update README
Signed-off-by: kingbri <bdashore3@proton.me>
2023-05-30 13:32:47 -04:00
kingbri
05535f6b94 ChromaDB: Add connection to a remote server
ChromaDB can be run in a remote context using docker. However, there
is no inbuilt authentication solution yet according to the documentation.

Therefore, this method is only useful if a user want to connect to an
unauthenticated ChromaDB instance. Only use this on a local network
or with mesh solutions such as Tailscale/Zerotier.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-05-30 13:08:56 -04:00
Cohee
01f35a1f21 Merge pull request #38 from BlipRanger/main 2023-05-29 20:38:38 +03:00
BlipRanger
9658808773 Add import / export functions for chromadb
Adds a quick way to dump all of the chromadb content for a given chat to a json file.
2023-05-29 13:08:07 -04:00
Cohee
7a525075a9 Merge pull request #36 from ramblingcoder/main
Docker support
2023-05-28 19:20:49 +03:00
ramblingcoder
a3035897d0 Update readme.md
correcting docker compose up to docker compose build
2023-05-28 09:21:01 -05:00
ramblingcoder
9622b04756 Create readme.md for docker 2023-05-28 09:11:44 -05:00
ramblingcoder
6512aa6fc3 Create Dockerfile 2023-05-28 09:10:41 -05:00
ramblingcoder
630f9a0054 Create docker-compose.yml 2023-05-28 09:10:08 -05:00
SillyLossy
8d402fa02d Add sentence transformers to requirements-complete 2023-05-23 15:43:20 +03:00
SillyLossy
0d69fb0406 Add chromadb purge method 2023-05-23 00:29:56 +03:00
Cohee
49f119bbe7 Update README.md 2023-05-18 14:03:42 +03:00
Cohee
017e536afd Merge pull request #27 from sanskar-mk2/main
Black formatter
2023-05-18 13:59:33 +03:00