Commit Graph

78 Commits

Author SHA1 Message Date
Blueprint Coding
3227e1c196 Updated Silero TTS to be compatible with STSL
Had to add absolute pathing for SILERO_SAMPLES_PATH, SILERO_SAMPLE_TEXT, & audio to set the extras directory based on the parent folder. Because of STSL dynamic install locations they were getting placed in the STSL folder instead of extras.

Should not effect regular launching via python.
2023-07-04 13:05:19 -06:00
YellowRoseCx
b17211bafa fix cpu mode
adds back "and not args.cpu" to device_string otherwise cpu mode will never trigger if a cuda device is installed in the machine
2023-06-30 00:13:20 -05:00
majick
dea4254e01 Fix: inverted sense bug with cuda sd float32
Inverting the use of float16 with SD on cuda was introduced with my MPS
hack.  Fixed.
Also, make the MPS changes more consistent with cuda_device, since we
don't need a hardcoded value any more.
2023-06-28 14:19:59 -07:00
majick
aee5e71e45 First pass at Apple Silicon MPS back end 2023-06-28 11:11:38 -07:00
SillyLossy
5b8d9e2c92 [Feature request] Specify which GPU to use if CUDA is selected as a command line argument. #65 2023-06-26 11:24:05 +03:00
SillyLossy
24ea1e8a19 Lint spaces 2023-06-25 21:02:29 +03:00
BlipRanger
5b4753b719 Respect requested query number 2023-06-25 01:01:03 -04:00
BlipRanger
7b733e7498 Initial work on multichat chroma 2023-06-24 14:49:08 -04:00
SillyLossy
ff0e9a0ba3 Merge branch 'main' of https://github.com/Cohee1207/SillyTavern-extras 2023-06-24 21:32:08 +03:00
SillyLossy
01d6c9a431 Add ignore of tts samples to API key 2023-06-24 21:31:49 +03:00
SillyLossy
6386caabec Fix CUDA mode. 2023-06-22 12:15:31 +03:00
johnbenac
add7daa61b sorts messages in ChromaDB export by 'date' order 2023-06-22 00:25:53 -04:00
SillyLossy
db0b232903 Extra modules (except SD) now use CPU by default 2023-06-18 21:51:31 +03:00
BlipRanger
13628591e9 Line removal 2023-06-17 20:53:03 -04:00
BlipRanger
7d5582584e Make chromadb persistence optional
Allows for the use of the `--chroma-persist` and `--no-chroma-persist` args. Still defaults to true.
2023-06-17 20:51:42 -04:00
SillyLossy
eb7c4b68ff #53 Fix buffering of SD output image 2023-06-11 13:42:30 +03:00
SillyLossy
bb0ae04976 Add rate to Edge TTS 2023-06-10 15:37:37 +03:00
SillyLossy
34b1b3afda Add response compression 2023-06-04 15:00:13 +03:00
SillyLossy
c9e1ced4f2 Add editorconfig 2023-06-04 12:40:36 +03:00
SillyLossy
a707dd02ff [Feature] Edge Text to speech #34 2023-06-04 12:38:36 +03:00
SillyLossy
a0000347e9 Remove unused modules 2023-06-04 01:58:49 +03:00
SillyLossy
befdc746c5 Remote ChromaDB REST api errors #42 2023-06-04 01:37:33 +03:00
kingbri
8381305f70 Server: Add API key for security
When the extras server was hosted publicly, there was a huge security
risk of anyone finding a cloudflare tunnel URL and directly querying
API routes.

However, this had a simple solution of implementing middleware to check
if a generated API key is valid. Since the server is simple, the API
key is a string of bytes stored in a textfile. If that textfile is
deleted, extras will automatically create a new API key/textfile.

Additionally, this is enabled via an optional argument to prevent
local user irritation.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-06-02 22:26:54 -04:00
BlipRanger
bf59b363ca Add persistence to chromadb
Saves chromadb to specified persistence folder (with default being .chroma_db). Purge correctly purges persistence folder.
2023-05-30 18:14:00 -04:00
kingbri
05535f6b94 ChromaDB: Add connection to a remote server
ChromaDB can be run in a remote context using docker. However, there
is no inbuilt authentication solution yet according to the documentation.

Therefore, this method is only useful if a user want to connect to an
unauthenticated ChromaDB instance. Only use this on a local network
or with mesh solutions such as Tailscale/Zerotier.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-05-30 13:08:56 -04:00
BlipRanger
9658808773 Add import / export functions for chromadb
Adds a quick way to dump all of the chromadb content for a given chat to a json file.
2023-05-29 13:08:07 -04:00
SillyLossy
0d69fb0406 Add chromadb purge method 2023-05-23 00:29:56 +03:00
Sanskar Tiwari
4c6ae72d94 move constants and run through black 2023-05-18 10:27:25 +05:30
Mark Ceter
71013c381f Add arbitrary metadata to message 2023-05-17 18:37:22 +00:00
Mark Ceter
ed43eb0aa5 Remove debug print 2023-05-17 17:13:57 +00:00
Mark Ceter
6c281c3b59 Add chromadb 2023-05-17 17:10:16 +00:00
SillyLossy
586f6dbd74 Add restore faces and HR fix to remote SD 2023-05-17 16:20:36 +03:00
SillyLossy
a3cedf5ffb Up quality of SD images a bit 2023-05-17 14:28:39 +03:00
SillyLossy
0a97211137 Fix SD scale float type matching 2023-05-17 13:55:39 +03:00
SillyLossy
42767bd6e8 Add Silero TTS server 2023-05-12 00:31:50 +03:00
SillyLossy
782694afe2 Replace default emotion model 2023-05-09 10:50:29 +03:00
SillyLossy
435dea1acd Remove set model from SD call 2023-05-05 15:12:13 +03:00
SillyLossy
03b3557ec4 Save SD images 2023-05-05 14:03:55 +03:00
SillyLossy
5dd7dd2a8f Add space between SD prefix and prompt 2023-05-04 17:59:44 +03:00
SillyLossy
0dc0dde12e Add more parameters for SD module 2023-05-04 17:51:27 +03:00
SillyLossy
9f03572a15 (experimental) Add manual gc calls 2023-04-23 00:19:56 +03:00
SillyLossy
b0a36f4aaf Add more stop words to summarized 2023-04-21 01:11:25 +03:00
SillyLossy
97f44b1695 Chat image thumbnailing 2023-04-18 00:26:20 +03:00
SillyLossy
51993137d5 Add console logging for extensions API 2023-04-17 23:29:37 +03:00
SillyLossy
154a0facb4 Text classify truncation 2023-04-14 13:50:58 +03:00
SillyLossy
28351a4ca8 Chunked summarization 2023-04-14 13:41:48 +03:00
Babnam
14b362a5f7 feature: more sd endpoints and parameters
Added sd endpoints for getting available models, current model, available samplers and setting the current model. In addition, added the ability to set the sampler, steps, cfg and model with the '/api/image' API call.
2023-04-11 20:55:03 +02:00
Babnam
bda0aec777 feature: implemented the ability to use a remote sd backend 2023-04-11 16:16:17 +02:00
SillyLossy
2ea8564520 Remove outdated stuff 2023-04-05 01:36:56 +03:00
SillyLossy
044708fff4 Properly dispose of poe client 2023-04-03 13:02:07 +03:00