[GH-ISSUE #720] Regarding inputted speaker content #441

Closed
opened 2026-10-20 09:59:22 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @suzhenghang on GitHub (Jul 10, 2023).
Original GitHub issue: https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/issues/720

Because retrieval features are used during inference to replace input features in order to prevent speaker identity leakage, but how can we ensure that the generated speech still corresponds to the original input content in terms of the speaker's voice?

feats = (
torch.from_numpy(npy).unsqueeze(0).to(self.device) * index_rate
+ (1 - index_rate) * feats
)

Originally created by @suzhenghang on GitHub (Jul 10, 2023). Original GitHub issue: https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/issues/720 Because retrieval features are used during inference to replace input features in order to prevent speaker identity leakage, but how can we ensure that the generated speech still corresponds to the original input content in terms of the speaker's voice? feats = ( torch.from_numpy(npy).unsqueeze(0).to(self.device) * index_rate + (1 - index_rate) * feats )
Author
Owner

@RVC-Boss commented on GitHub (Jul 11, 2023):

Replace with the most similar features to ensure semantic consistency.

<!-- gh-comment-id:1630000424 --> @RVC-Boss commented on GitHub (Jul 11, 2023): Replace with the most similar features to ensure semantic consistency.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
RVC-Project/Retrieval-based-Voice-Conversion-WebUI#441
No description provided.