SillyTavern/Extension-DupeFinder
1
0
Fork 0
mirror of https://github.com/SillyTavern/Extension-DupeFinder.git synced 2026-10-15 13:31:57 +00:00
Code Issues 2 Projects Packages Wiki Activity
Adds an ability to cluster characters by similarity groups to easily find duplicates.
20 commits 2 branches 0 tags 358 KiB
  • JavaScript 99.5%
  • CSS 0.5%
Find a file
Exact
Cohee f77fa2e406 Fix npm audit
2026-04-06 00:53:08 +03:00
dist Fix npm audit 2026-04-06 00:53:08 +03:00
src Update for new button container 2025-07-17 23:40:06 +03:00
.gitignore Initial commit 2024-03-17 14:52:05 +02:00
LICENSE Initial commit 2024-03-17 14:52:05 +02:00
manifest.json Load styles with CSS loader 2024-03-23 23:18:07 +02:00
package-lock.json Fix npm audit 2026-04-06 00:53:08 +03:00
package.json Load styles with CSS loader 2024-03-23 23:18:07 +02:00
README.md Add sentence similarity method by @sinnerai 2024-03-20 20:42:50 +02:00
webpack.config.js Load styles with CSS loader 2024-03-23 23:18:07 +02:00

README.md

Duplicate Finder

Adds an ability to cluster characters by similarity groups to easily find duplicates.

How to use

  1. Install the extension using a built-in installer.
  2. Find a new button in the character list view, left to a search bar. A modal window will open after you click it.
  3. There you can adjust the similarity threshold - the higher the number, the more "similar" the character cards should be to get grouped together.
  4. Select desired search method. Sentence similarity is less accurate but fast, Levenshtein distance is very slow but accurate.
  5. Click "Calculate" to run the search. This may take some time, especially on large character libraries.
  6. If any of the character clusters match the search criteria, they will be displayed in a list. You can click the "View" button to open a chosen character.

Prerequisites

SillyTavern - latest staging version preferred, or stable release >= 1.11.7.

This won't work on any older versions.

What fields are evaluated in the search?

By default, only the V1 character card fields are getting checked:

  • Name
  • Description
  • First message
  • Personality
  • Scenario
  • Examples of dialogue

You can include V2 card fields with the "Configure Fields" option.

Why the heck it takes so long?

Be patient.

License and credits

Initial idea and implementation by @Cohee1207

Sentence similarity method by @sinnerai

License: AGPLv3