[GH-ISSUE #1055] RMVPE Functionality in Colab #694

Open
opened 2026-10-20 10:02:00 +00:00 by bsakaguchi · 7 comments
Owner

Originally created by @RECKENEFIN on GitHub (Aug 19, 2023).
Original GitHub issue: https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/issues/1055

I just updated RVC on my local setup (which is only powerful enough to handle inference) and noticed the RMVPE option. I wanted to try it out on the training side, but the Colab doesn't appear to have that functionality enabled. I've noticed that the Colab does seem to be behind what the local version has in terms of features (no 48k v2 support, no Crepe option, no RMVPE option, etc.). Is there a specific reason for this, or am I missing something?

Originally created by @RECKENEFIN on GitHub (Aug 19, 2023). Original GitHub issue: https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/issues/1055 I just updated RVC on my local setup (which is only powerful enough to handle inference) and noticed the RMVPE option. I wanted to try it out on the training side, but the Colab doesn't appear to have that functionality enabled. I've noticed that the Colab does seem to be behind what the local version has in terms of features (no 48k v2 support, no Crepe option, no RMVPE option, etc.). Is there a specific reason for this, or am I missing something?
Author
Owner

@RVC-Boss commented on GitHub (Aug 19, 2023):

Because WebUI is udpated by me, and colab is updated by some other persons.
Somebody to pr the updated colab version is needed.

<!-- gh-comment-id:1684911636 --> @RVC-Boss commented on GitHub (Aug 19, 2023): Because WebUI is udpated by me, and colab is updated by some other persons. Somebody to pr the updated colab version is needed.
Author
Owner

@RECKENEFIN commented on GitHub (Aug 21, 2023):

Got it. Well, until there's an official update, I did some tinkering and got it working in a copy of the v2 Colab Notebook.

  • Added torchcrepe to the Dependencies list
  • Updated Clone Repository to fetch at Commit 56917db (from the day of the latest version release)
  • Added RMVPE.pt to the Weights Download list
  • Enabled all the v2 weights (since those all seem to be functional now) and disabled all the v1 & v2 32k weights (since there isn't a 32k option in the current webUI).

I ran a small model through it and everything seemed to work fine. A few DEBUG notifications in the terminal during training, but nothing that ground things to a halt. I'm sure there are some back end improvements that would streamline it a bit more, but it's functional enough for me right now.

<!-- gh-comment-id:1685637925 --> @RECKENEFIN commented on GitHub (Aug 21, 2023): Got it. Well, until there's an official update, I did some tinkering and got it working in a copy of the v2 Colab Notebook. - Added `torchcrepe` to the Dependencies list - Updated Clone Repository to fetch at Commit 56917db (from the day of the latest version release) - Added `RMVPE.pt` to the Weights Download list - Enabled all the v2 weights (since those all seem to be functional now) and disabled all the v1 & v2 32k weights (since there isn't a 32k option in the current webUI). I ran a small model through it and everything seemed to work fine. A few DEBUG notifications in the terminal during training, but nothing that ground things to a halt. I'm sure there are some back end improvements that would streamline it a bit more, but it's functional enough for me right now.
Author
Owner

@Denis6902 commented on GitHub (Aug 21, 2023):

Got it. Well, until there's an official update, I did some tinkering and got it working in a copy of the v2 Colab Notebook.

  • Added torchcrepe to the Dependencies list
  • Updated Clone Repository to fetch at Commit 56917db (from the day of the latest version release)
  • Added RMVPE.pt to the Weights Download list
  • Enabled all the v2 weights (since those all seem to be functional now) and disabled all the v1 & v2 32k weights (since there isn't a 32k option in the current webUI).

I ran a small model through it and everything seemed to work fine. A few DEBUG notifications in the terminal during training, but nothing that ground things to a halt. I'm sure there are some back end improvements that would streamline it a bit more, but it's functional enough for me right now.

Hi, can you give me link please? Thanks

<!-- gh-comment-id:1686310909 --> @Denis6902 commented on GitHub (Aug 21, 2023): > Got it. Well, until there's an official update, I did some tinkering and got it working in a copy of the v2 Colab Notebook. > > * Added `torchcrepe` to the Dependencies list > * Updated Clone Repository to fetch at Commit [56917db](https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/commit/56917dbeca8d268ce9d23af90b0ee66fc8761988) (from the day of the latest version release) > * Added `RMVPE.pt` to the Weights Download list > * Enabled all the v2 weights (since those all seem to be functional now) and disabled all the v1 & v2 32k weights (since there isn't a 32k option in the current webUI). > > I ran a small model through it and everything seemed to work fine. A few DEBUG notifications in the terminal during training, but nothing that ground things to a halt. I'm sure there are some back end improvements that would streamline it a bit more, but it's functional enough for me right now. Hi, can you give me link please? Thanks
Author
Owner

@RECKENEFIN commented on GitHub (Aug 21, 2023):

Sure, no problem. I'm new to the whole Github thing when it comes to etiquette and whatnot, and I know just enough about coding to be dangerous.

Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt

(Obviously change the file extension back to .ipynb. Couldn't attach that file format.)

<!-- gh-comment-id:1686356523 --> @RECKENEFIN commented on GitHub (Aug 21, 2023): Sure, no problem. I'm new to the whole Github thing when it comes to etiquette and whatnot, and I know just enough about coding to be dangerous. [Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt](https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/files/12396547/Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt) (Obviously change the file extension back to `.ipynb`. Couldn't attach that file format.)
Author
Owner

@mickeykiller commented on GitHub (Sep 6, 2023):

Sure, no problem. I'm new to the whole Github thing when it comes to etiquette and whatnot, and I know just enough about coding to be dangerous.

Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt

(Obviously change the file extension back to .ipynb. Couldn't attach that file format.)

HI, I change colab code as same as "Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt" you provide
but I find the issue is that
!cp /content/Retrieval-based-Voice-Conversion-WebUI/logs/{MODELNAME}/added_.index /content/drive/MyDrive/
!cp /content/Retrieval-based-Voice-Conversion-WebUI/logs/{MODELNAME}/total_
.npy /content/drive/MyDrive/
doesn't work.
Also the main function don't produce ".index file" and ".npy file".
How to adjust that?

<!-- gh-comment-id:1707904693 --> @mickeykiller commented on GitHub (Sep 6, 2023): > Sure, no problem. I'm new to the whole Github thing when it comes to etiquette and whatnot, and I know just enough about coding to be dangerous. > > [Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt](https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/files/12396547/Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt) > > (Obviously change the file extension back to `.ipynb`. Couldn't attach that file format.) HI, I change colab code as same as "Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt" you provide but I find the issue is that !cp /content/Retrieval-based-Voice-Conversion-WebUI/logs/{MODELNAME}/added_*.index /content/drive/MyDrive/ !cp /content/Retrieval-based-Voice-Conversion-WebUI/logs/{MODELNAME}/total_*.npy /content/drive/MyDrive/ doesn't work. Also the main function don't produce ".index file" and ".npy file". How to adjust that?
Author
Owner

@SharonCooper commented on GitHub (Dec 31, 2023):

Sure, no problem. I'm new to the whole Github thing when it comes to etiquette and whatnot, and I know just enough about coding to be dangerous.

Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt

(Obviously change the file extension back to .ipynb. Couldn't attach that file format.)

Thank you for your work. Is it working smoothly so far, for the RMVPE part?

<!-- gh-comment-id:1873016685 --> @SharonCooper commented on GitHub (Dec 31, 2023): > Sure, no problem. I'm new to the whole Github thing when it comes to etiquette and whatnot, and I know just enough about coding to be dangerous. > > > > [Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt](https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/files/12396547/Retrieval_based_Voice_Conversion_WebUI_v2_RMVPE.txt) > > > > (Obviously change the file extension back to `.ipynb`. Couldn't attach that file format.) Thank you for your work. Is it working smoothly so far, for the RMVPE part?
Author
Owner

@RECKENEFIN commented on GitHub (Mar 7, 2024):

So far so good. Haven't had any issues with it thus far.

<!-- gh-comment-id:1983977432 --> @RECKENEFIN commented on GitHub (Mar 7, 2024): So far so good. Haven't had any issues with it thus far.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
RVC-Project/Retrieval-based-Voice-Conversion-WebUI#694
No description provided.