[GH-ISSUE #1] Feature Request: Automatically remove duplicates #1

New issue

Open

opened 2026-10-15 13:25:06 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-15 13:25:06 +00:00

Owner

Originally created by @Adeor on GitHub (Feb 12, 2025).
Original GitHub issue: https://github.com/SillyTavern/Extension-DupeFinder/issues/1

I'm currently merging my old and new characters and there are a lot of duplicates. A function to automatically remove duplicates would be nice.
I think the following removal mechanic (from top to bottom) would be a sane default:

If there is an associated chat with one character, but not with the others, keep this character. If there are multiple characters with associated chats longer than 1 messages (which is the into, if the user opens the chat, but doesn't interact with it), stop the auto-removal for those chars.
If all matching characters are from the same creator, keep the newest one (since it's likely the updated version) - Based on creation date and if it's the same based on file modification date
If there is no associated chat with any of the matched characters, they match perfectly and the filename of some of them ends with a number (e.g. Char vs Char1), keep the one without a filename at the end

But any other sane removal mechanic would be appricated as well.

Originally created by @Adeor on GitHub (Feb 12, 2025). Original GitHub issue: https://github.com/SillyTavern/Extension-DupeFinder/issues/1 I'm currently merging my old and new characters and there are a lot of duplicates. A function to automatically remove duplicates would be nice. I think the following removal mechanic (from top to bottom) would be a sane default: 1. If there is an associated chat with one character, but not with the others, keep this character. If there are multiple characters with associated chats longer than 1 messages (which is the into, if the user opens the chat, but doesn't interact with it), stop the auto-removal for those chars. 2. If all matching characters are from the same creator, keep the newest one (since it's likely the updated version) - Based on creation date and if it's the same based on file modification date 3. If there is no associated chat with any of the matched characters, they match perfectly and the filename of some of them ends with a number (e.g. `Char` vs `Char1`), keep the one without a filename at the end But any other sane removal mechanic would be appricated as well.

bsakaguchi commented

2026-10-15 13:25:06 +00:00

Author

Owner

@Cohee1207 commented on GitHub (Feb 12, 2025):

https://github.com/SillyTavern/Extension-DupeFinder

@Cohee1207 commented on GitHub (Feb 12, 2025): https://github.com/SillyTavern/Extension-DupeFinder

bsakaguchi commented

2026-10-15 13:25:07 +00:00

Author

Owner

@Adeor commented on GitHub (Feb 14, 2025):

I opened the issue under the linked repo and didn't see anything in the README, that is relevant to my request. Could you clarify what you mean?

@Adeor commented on GitHub (Feb 14, 2025): I opened the issue under the linked repo and didn't see anything in the README, that is relevant to my request. Could you clarify what you mean?

No labels

pull-request

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

SillyTavern/Extension-DupeFinder#1

No description provided.

Rows
Columns