[GH-ISSUE #2012] GANs #1352

Open
opened 2026-10-20 10:08:19 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @litsa-the-dancer on GitHub (Apr 23, 2024).
Original GitHub issue: https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/issues/2012

I will make this short and quick for all of you to read. I think it would be a good idea if hifigan was switched with bigvgan for better fidelity and mel representation, or at the very least vocos. It would probably be a good idea to have this change included with RVC v3. @RVC-Boss

Originally created by @litsa-the-dancer on GitHub (Apr 23, 2024). Original GitHub issue: https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/issues/2012 I will make this short and quick for all of you to read. I think it would be a good idea if hifigan was switched with bigvgan for better fidelity and mel representation, or at the very least vocos. It would probably be a good idea to have this change included with RVC v3. @RVC-Boss
Author
Owner

@yxlllc commented on GitHub (Apr 24, 2024):

We have tried it, but bigvgan training is a bit difficult and the improvement is not obvious.

<!-- gh-comment-id:2074259770 --> @yxlllc commented on GitHub (Apr 24, 2024): We have tried it, but bigvgan training is a bit difficult and the improvement is not obvious.
Author
Owner

@litsa-the-dancer commented on GitHub (Apr 24, 2024):

We have tried it, but bigvgan training is a bit difficult and the improvement is not obvious.

Im pretty sure it can in fact yield better results and help with sibilance and breathing. Not to mention, it'll probably help the GAN itself adapt to the data more efficiently with less hiccups. Not saying that it'll fix everything up just like that however it's still important to note that the better data representation we have, the better our model will be able to perform on said data theoretically. The quality itself may not receive a major boost but still, it can aid. Also having it out for public use is the best way to really test if the feature itself is actually viable.

<!-- gh-comment-id:2075790474 --> @litsa-the-dancer commented on GitHub (Apr 24, 2024): > We have tried it, but bigvgan training is a bit difficult and the improvement is not obvious. Im pretty sure it can in fact yield better results and help with sibilance and breathing. Not to mention, it'll probably help the GAN itself adapt to the data more efficiently with less hiccups. Not saying that it'll fix everything up just like that however it's still important to note that the better data representation we have, the better our model will be able to perform on said data theoretically. The quality itself may not receive a major boost but still, it can aid. Also having it out for public use is the best way to really test if the feature itself is actually viable.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
RVC-Project/Retrieval-based-Voice-Conversion-WebUI#1352
No description provided.