RVC-Project/Retrieval-based-Voice-Conversion-WebUI

Fork 0

mirror of https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI.git synced 2026-11-05 00:27:30 +00:00

[GH-ISSUE #537] Does this support other languages than english? #304

New issue

Closed

opened 2026-10-20 09:57:56 +00:00 by bsakaguchi · 8 comments

bsakaguchi commented

2026-10-20 09:57:56 +00:00

Owner

Originally created by @PudyJapan on GitHub (Jun 16, 2023).
Original GitHub issue: https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/issues/537

Hi,

I tried with Turkish speech, but the converted voice changes pronunciation hugely it's not even understandable.

I tried increasing the training epochs but that resulted in even more deviation in pronunciation.

Is that because of the speech language or is it because of some problem with my training and input data?

Thank you for advance.

Originally created by @PudyJapan on GitHub (Jun 16, 2023). Original GitHub issue: https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/issues/537 Hi, I tried with Turkish speech, but the converted voice changes pronunciation hugely it's not even understandable. I tried increasing the training epochs but that resulted in even more deviation in pronunciation. Is that because of the speech language or is it because of some problem with my training and input data? Thank you for advance.

bsakaguchi

2026-10-20 09:57:56 +00:00

closed this issue
added the
stale
label

bsakaguchi commented

2026-10-20 09:57:56 +00:00

Author

Owner

@sethtallen commented on GitHub (Jun 20, 2023):

How much training data do you have after silence is removed?
Are you verifying there isn't background noise?
How many epochs are you training to?
Are you using v1 or v2 while training?
Is both the training and target audio in Turkish?

@sethtallen commented on GitHub (Jun 20, 2023): - How much training data do you have after silence is removed? - Are you verifying there isn't background noise? - How many epochs are you training to? - Are you using v1 or v2 while training? - Is both the training and target audio in Turkish?

bsakaguchi commented

2026-10-20 09:57:56 +00:00

Author

Owner

@cadid1961 commented on GitHub (Jun 24, 2023):

Same here. I speak catalan and spanish. Really awsome results, I agree and a lot of thanks for the code! But it speaks/sings as an english speaker would in my languages. It's very notorious in the vowels. Is there any way to include non english phonemes? Thanks in advance!

@cadid1961 commented on GitHub (Jun 24, 2023): Same here. I speak catalan and spanish. Really awsome results, I agree and a lot of thanks for the code! But it speaks/sings as an english speaker would in my languages. It's very notorious in the vowels. Is there any way to include non english phonemes? Thanks in advance!

bsakaguchi commented

2026-10-20 09:57:57 +00:00

Author

Owner

@PudyJapan commented on GitHub (Jun 24, 2023):

@sethtallen Thank you for getting back to me and I am sorry for my late response.

How much training data do you have after silence is removed?
- Roughly 4 minutes
Are you verifying there isn't background noise?
- The background noise is minimal, almost can't be heard. I used ultimatevocalremovergui.
How many epochs are you training to?
- 200
Are you using v1 or v2 while training?
- V2
Is both the training and target audio in Turkish?
- Yes

@PudyJapan commented on GitHub (Jun 24, 2023): @sethtallen Thank you for getting back to me and I am sorry for my late response. - How much training data do you have after silence is removed? - Roughly 4 minutes - Are you verifying there isn't background noise? - The background noise is minimal, almost can't be heard. I used ultimatevocalremovergui. - How many epochs are you training to? - 200 - Are you using v1 or v2 while training? - V2 - Is both the training and target audio in Turkish? - Yes

bsakaguchi commented

2026-10-20 09:57:57 +00:00

Author

Owner

@sethtallen commented on GitHub (Jun 26, 2023):

@sethtallen Thank you for getting back to me and I am sorry for my late response.

* How much training data do you have after silence is removed?
  
  * Roughly 4 minutes

* Are you verifying there isn't background noise?
  
  * The background noise is minimal, almost can't be heard. I used ultimatevocalremovergui.

* How many epochs are you training to?
  
  * 200

* Are you using v1 or v2 while training?
  
  * V2

* Is both the training and target audio in Turkish?
  
  * Yes

I would recommend more training data. Also save checkpoints and use those and compare it against the 200 epoch model. i.e. a model trained on 150 epochs, 100, 50, etc. See if you notice a difference. I'm not an expert on model training but I have seen people say you can 'overtrain' a model. V2 doesn't need as many epochs. Maybe 200 epochs on 4 minutes is too much. Still I'd recommend at least 10 minutes.

I just want to add context from my personal perspective. I only speak English fluently. I'm learning Japanese. I can't tell when I convert Japanese audio with a model trained on English if it sounds 'natural'. However, when I convert English audio using a model trained on Japanese there is very clear pronunciations that a Japanese person speaking English would make. I assume this is due to sounds which exist in English don't exist in Japanese so the model does not 'learn' them.

There is also a Japanese, Korean, and Chinese community involved in this. So I think its safe to say it does support other languages than English.

@sethtallen commented on GitHub (Jun 26, 2023): > @sethtallen Thank you for getting back to me and I am sorry for my late response. > > * How much training data do you have after silence is removed? > > * Roughly 4 minutes > > * Are you verifying there isn't background noise? > > * The background noise is minimal, almost can't be heard. I used ultimatevocalremovergui. > > * How many epochs are you training to? > > * 200 > > * Are you using v1 or v2 while training? > > * V2 > > * Is both the training and target audio in Turkish? > > * Yes I would recommend more training data. Also save checkpoints and use those and compare it against the 200 epoch model. i.e. a model trained on 150 epochs, 100, 50, etc. See if you notice a difference. I'm not an expert on model training but I have seen people say you can 'overtrain' a model. V2 doesn't need as many epochs. Maybe 200 epochs on 4 minutes is too much. Still I'd recommend at least 10 minutes. --- I just want to add context from my personal perspective. I only speak English fluently. I'm learning Japanese. I can't tell when I convert Japanese audio with a model trained on English if it sounds 'natural'. However, when I convert English audio using a model trained on Japanese there is very clear pronunciations that a Japanese person speaking English would make. I assume this is due to sounds which exist in English don't exist in Japanese so the model does not 'learn' them. There is also a Japanese, Korean, and Chinese community involved in this. So I think its safe to say it does support other languages than English.

bsakaguchi commented

2026-10-20 09:57:57 +00:00

Author

Owner

@PudyJapan commented on GitHub (Jun 26, 2023):

@sethtallen
Sounds good, I will check the other epochs and will try with 10 minutes of training data and post the results.
I appreciate your help.

@PudyJapan commented on GitHub (Jun 26, 2023): @sethtallen Sounds good, I will check the other epochs and will try with 10 minutes of training data and post the results. I appreciate your help.

bsakaguchi commented

2026-10-20 09:57:57 +00:00

Author

Owner

@cadid1961 commented on GitHub (Jun 28, 2023):

For me problem solved with more training. With 400 epochs it's almost OK!!!
Thanks again!

@cadid1961 commented on GitHub (Jun 28, 2023): For me problem solved with more training. With 400 epochs it's almost OK!!! Thanks again!

bsakaguchi commented

2026-10-20 09:57:57 +00:00

Author

Owner

@chenglong95007 commented on GitHub (Mar 4, 2024):

Would it be Okay for Indian Language?

@chenglong95007 commented on GitHub (Mar 4, 2024): Would it be Okay for Indian Language?

bsakaguchi commented

2026-10-20 09:57:57 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Apr 28, 2024):

This issue was closed because it has been inactive for 15 days since being marked as stale.

@github-actions[bot] commented on GitHub (Apr 28, 2024): This issue was closed because it has been inactive for 15 days since being marked as stale.

bsakaguchi referenced this issue

2026-10-20 10:14:13 +00:00

[GH-ISSUE #2860] error #2060