Commit Graph

8 Commits

Author SHA1 Message Date
Juha Jeronen
ba28f6e5ee update docstring 2023-12-22 11:47:37 +02:00
Juha Jeronen
b1489ae668 merge TODO lists into the one in app.py, remove done TODO item. 2023-12-22 11:45:51 +02:00
Juha Jeronen
ebbdc6cc88 talkinghead-next new features
- Rewrite sway animation (much more natural now)
 - History-free, rate-based formulation
 - Use all non-morph axes: head, neck, body
 - Every few seconds, randomize a new deviation from the target pose for all sway axes.
 - Assign this as the target pose, and let the pose interpolator perform the actual animation.
 - Micro-sway: add small dynamic noise (re-generated every frame) on top of sway target pose.
   - This makes the motion look more natural, especially once we are near the target pose.
- Add breathing animation
- When entering "confusion" emotion, allow blinking quickly in succession
- Add framerate limiter, currently hardcoded to send ~24 FPS
  - Reduces average GPU usage if the GPU renders faster than this.
2023-12-22 10:59:04 +02:00
Juha Jeronen
4c6f843ff9 Talkinghead performance improvements and refactoring (#207)
* talkinghead: fix and improve THA3 manual poser

* server.py: no, don't yet use fp16 for talkinghead

* talkinghead: remove wxPython dependency from live mode

* comment out unused functions

* add TODO list

* coding style

* remove unused import

* add TODO marker

* message wordings

* fix typos in variable names

* talkinghead updates

* talkinghead updates

* Empty commit

* presentation order, sectioning

* fix the inMotion flag update

* mark a TODO

* refactor

* remove done TODO items

* mark a TODO

* comment wording

* pause animation while loading a new image

* parser doesn't belong here, not a command-line app anymore

* message wording

* use finally

* remove superfluous "global" declarations

* lots of cleanup

* remove silly sys.path entry

* improve docstring

* oops

* app.py now only serves the live mode for the plugin

* talkinghead live mode: remove ifacialmocap stuff (unused)

* improve comment

* list walking is so 1990s

* use double quotes consistently

* remove now-unused ifacialmocap-related files from the repo

* remove done TODO item

* improve docstring

* update comment

* remove now-unused function

* update comment

* improve docstring

* add TODO marker

* oops, typo

* add --talkinghead-model command-line option to server.py

Default is 'auto': float16 on GPU, float32 on CPU.

* talkinghead: auto-install THA3 models if needed

* remove tha3/models from git repo (have autodownload now)

* Add hf-hub as explicit dependency

* Add THA models to gitignore

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-12-21 23:48:25 +02:00
Juha Jeronen
7ca92eaeac talkinghead: fix and improve THA3 manual poser (#204)
* talkinghead: fix and improve THA3 manual poser

* server.py: no, don't yet use fp16 for talkinghead
2023-12-20 01:21:24 +02:00
Cohee
c5d1773f6d talkinghead inital.png path broken on Linux #198 2023-12-14 00:44:09 +02:00
Cohee
ed3b0252be Normalize initial.png paths #154 2023-09-10 15:10:52 +03:00
joe
7ad0bb5598 live2d -> talkinghead name change 2023-08-11 06:50:59 +09:00