Commit Graph

472 Commits

Author SHA1 Message Date
Juha Jeronen
ba28f6e5ee update docstring 2023-12-22 11:47:37 +02:00
Juha Jeronen
b1489ae668 merge TODO lists into the one in app.py, remove done TODO item. 2023-12-22 11:45:51 +02:00
Juha Jeronen
ebbdc6cc88 talkinghead-next new features
- Rewrite sway animation (much more natural now)
 - History-free, rate-based formulation
 - Use all non-morph axes: head, neck, body
 - Every few seconds, randomize a new deviation from the target pose for all sway axes.
 - Assign this as the target pose, and let the pose interpolator perform the actual animation.
 - Micro-sway: add small dynamic noise (re-generated every frame) on top of sway target pose.
   - This makes the motion look more natural, especially once we are near the target pose.
- Add breathing animation
- When entering "confusion" emotion, allow blinking quickly in succession
- Add framerate limiter, currently hardcoded to send ~24 FPS
  - Reduces average GPU usage if the GPU renders faster than this.
2023-12-22 10:59:04 +02:00
Juha Jeronen
4c6f843ff9 Talkinghead performance improvements and refactoring (#207)
* talkinghead: fix and improve THA3 manual poser

* server.py: no, don't yet use fp16 for talkinghead

* talkinghead: remove wxPython dependency from live mode

* comment out unused functions

* add TODO list

* coding style

* remove unused import

* add TODO marker

* message wordings

* fix typos in variable names

* talkinghead updates

* talkinghead updates

* Empty commit

* presentation order, sectioning

* fix the inMotion flag update

* mark a TODO

* refactor

* remove done TODO items

* mark a TODO

* comment wording

* pause animation while loading a new image

* parser doesn't belong here, not a command-line app anymore

* message wording

* use finally

* remove superfluous "global" declarations

* lots of cleanup

* remove silly sys.path entry

* improve docstring

* oops

* app.py now only serves the live mode for the plugin

* talkinghead live mode: remove ifacialmocap stuff (unused)

* improve comment

* list walking is so 1990s

* use double quotes consistently

* remove now-unused ifacialmocap-related files from the repo

* remove done TODO item

* improve docstring

* update comment

* remove now-unused function

* update comment

* improve docstring

* add TODO marker

* oops, typo

* add --talkinghead-model command-line option to server.py

Default is 'auto': float16 on GPU, float32 on CPU.

* talkinghead: auto-install THA3 models if needed

* remove tha3/models from git repo (have autodownload now)

* Add hf-hub as explicit dependency

* Add THA models to gitignore

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-12-21 23:48:25 +02:00
Cohee
47a5489142 Use pipeline for text summarization 2023-12-20 01:57:38 +02:00
Cohee
423f51e3f8 Use pipeline for image captioning 2023-12-20 01:28:53 +02:00
Juha Jeronen
7ca92eaeac talkinghead: fix and improve THA3 manual poser (#204)
* talkinghead: fix and improve THA3 manual poser

* server.py: no, don't yet use fp16 for talkinghead
2023-12-20 01:21:24 +02:00
Cohee
c5d1773f6d talkinghead inital.png path broken on Linux #198 2023-12-14 00:44:09 +02:00
Cohee
98535e6fa3 Add links to search results 2023-12-11 23:52:25 +02:00
deffcolony
1363fd242d added start.sh script for linux environments (#176)
* added start.sh for linux

* This script will start sillytavern-extras with conda
* Added tutorial on what flags you can use and how to add multiple flags

* changes env to extras + flag updates

* Dynamically find conda

* dirname which

* Whoops, spelled thsi wrong

* keep `which` to the last option

* remove which

* whoops, remove `exit`

* start.sh file with arguments

+modules.txt with arguments to use with start.sh
+start.sh that launches extras using the arguments of modules.txt

---------

Co-authored-by: Amrit Bhogal <ambhogal01@gmail.com>
2023-12-07 16:44:34 +02:00
Cohee
a51d993ff2 Add missing requirements 2023-12-02 15:26:53 +02:00
Cohee
f99ea5aa89 Add colab detection util 2023-11-30 02:03:11 +02:00
Cohee
aded5b4363 Add support for DuckDuckGo search engine in web search API 2023-11-28 22:39:35 +02:00
Cohee
05cab1c918 Add websearch module 2023-11-28 20:36:02 +02:00
Cohee
085b0a849d Update README.md 2023-11-20 15:44:41 +02:00
Cohee
10e6e1701b Create LICENSE 2023-11-20 15:41:40 +02:00
Cohee
c3ea117cab Relicense 2023-11-20 15:40:48 +02:00
Cohee
e32d0c30c2 Add language parameter for whisper 2023-11-19 21:10:41 +02:00
Cohee
61efbb9aa3 #187 Set condition_on_previous_text for whisper modules 2023-11-19 19:19:45 +02:00
Cohee
289bb2e86b Merge pull request #156 from yggdrasil75/patch-1
Update docker-compose.yml
2023-11-17 18:10:20 +02:00
Cohee
51a680946f Fix chroma embedding function 2023-11-16 18:28:52 +02:00
Cohee
1c868a693b Update README.md 2023-11-16 14:46:01 +02:00
Cohee
73eeef63bc #183 Rework requirement files 2023-11-16 14:11:16 +02:00
Cohee
6f3dd82ad4 Update CUDA requirements 2023-10-25 19:01:23 +03:00
Cohee
8d5d97b0ee Merge pull request #179 from YellowRoseCx/patch-2 2023-10-25 11:24:51 +03:00
YellowRoseCx
baf4f93c78 Update pytorch version in requirements-rocm.txt 2023-10-24 19:46:40 -05:00
Cohee
2830a5ff4e Fix requirements 2023-10-24 15:52:16 +03:00
Cohee
beb434ae78 Fix chromadb purge 2023-10-18 23:54:37 +03:00
Cohee
cbf3c944ac Update README.md 2023-10-13 22:02:15 +03:00
Cohee
e3d671a786 Fix accelerate version for M1 2023-10-13 20:33:00 +03:00
Cohee
0d73db91e7 Bump ChromaDB version 2023-09-18 22:35:42 +03:00
Cohee
600cc43c26 Merge pull request #165 from Dalethium/patch-4
Update docker-compose.yml to fix typo in #161
2023-09-17 15:19:13 +03:00
Daleth Darko
90f37f7168 Create api_key.txt
Required for docker to not load as directory
2023-09-17 08:17:30 -04:00
Daleth Darko
7db5fe99ef Update docker-compose.yml to fix typo in #161 2023-09-17 08:03:16 -04:00
Cohee
d1e41eddbb Merge pull request #161 from Dalethium/patch-1 2023-09-17 13:25:04 +03:00
Daleth Darko
ca6efc3905 Update docker-compose.yml to not re-download the models every launch 2023-09-17 06:21:58 -04:00
yggdrasil75
e3d3071b1e Update docker-compose.yml
fixes nvidia on windows
2023-09-10 09:45:40 -04:00
Cohee
cc711986b9 Merge pull request #155 from SillyTavern/neo
Normalize initial.png paths #154
2023-09-10 15:12:50 +03:00
Cohee
ed3b0252be Normalize initial.png paths #154 2023-09-10 15:10:52 +03:00
Cohee
debdc3192d Update README.md 2023-09-05 15:30:50 +03:00
Cohee
a559511ebf Merge branch 'neo' 2023-09-03 16:45:43 +03:00
Cohee
60045b599f Fix double memory consumption for classify module 2023-09-03 16:45:20 +03:00
Cohee
aac582a957 Merge pull request #145 from SillyTavern/neo
#144 Increase max content length limit
2023-09-01 14:36:55 +03:00
Cohee
5d51e752f4 #144 Increase max content length limit 2023-09-01 14:36:36 +03:00
Cohee
716324bd84 Merge pull request #139 from SillyTavern/neo
Neo
2023-08-29 20:26:15 +03:00
Cohee
fbc01f0cc5 Merge branch 'main' into neo 2023-08-29 20:25:24 +03:00
Cohee
b11448d43b Merge pull request #138 from donlinglok/neo 2023-08-29 10:15:58 +03:00
Cohee
8d64b02ea4 Merge pull request #137 from ouoertheo/ouoertheo/silero-max-char 2023-08-29 10:14:17 +03:00
donlinglok
aa708fb574 update docker setting 2023-08-29 11:48:04 +08:00
ouoertheo
e18aa42965 another silero version bump 2023-08-28 18:37:46 -05:00