Negative prompts now exclusive to their category

They now only autocomplete if their parent category is active in the config as well

README.md

@@ -7,15 +7,19 @@ Since some Stable Diffusion models were trained using this information, for exam
 
 I created this script as a convenience tool since it reduces the need of switching back and forth between the web UI and a booru site to copy-paste tags.
 
-[[Setup instructions]](#installation)
+You can either download the files manually as described below, or use a pre-packaged version from [Releases](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/releases).
 
 ### Disclaimer:
-This script is definitely not optimized, and it's not very intelligent. The tags are simply recommended based on their natural order in the CSV, which is their respective image count for the default Danbooru tag list. Also, at least for now, neither keyboard selection for tags nor completion for negative or img2img prompt textboxes is supported, and there's no way to turn the feature off from the ui, but I plan to get around to those features eventually.
+This script is definitely not optimized, and it's not very intelligent. The tags are simply recommended based on their natural order in the CSV, which is their respective image count for the default Danbooru tag list. Also, at least for now there's no way to turn the script off from the ui, but I plan to get around to that eventually.
+
+### Known Issues:
+If `replaceUnderscores` is active, the script will currently only partly replace edited tags containing multiple words in brackets.
+For example, editing `atago (azur lane)`, it would be replaced with e.g. `taihou (azur lane), lane)`, since the script currently doesn't see the second part of the bracket as the same tag. So in those cases you should delete the old tag beforehand.
 
 ## Screenshots
-Demo video
+Demo video (with keyboard navigation):
 
-https://user-images.githubusercontent.com/34448969/195185810-547d8d0a-bf87-465d-91f1-7fb5c3259c3f.mp4
+https://user-images.githubusercontent.com/34448969/195344430-2b5f9945-b98b-4943-9fbc-82cf633321b1.mp4
 
 Dark and Light mode supported, including tag colors:
 
@@ -27,22 +31,51 @@ Dark and Light mode supported, including tag colors:
 Simply put `tagAutocomplete.js` into the `javascript` folder of your web UI installation. It will run automatically the next time the web UI is started.
 For the script to work, you also need to download the `tags` folder from this repo and paste it and its contents into the web UI root, or create them there manually.
 
-The tags folder contains two files: `config.json` and `danbooru.csv`. This is the data the script uses for autocompletion.
+The tags folder contains `config.json` and the tag data the script uses for autocompletion. By default, Danbooru and e621 tags are included.
 
 ### Config
 The config contains the following settings and defaults:
 ```json
 {
 	"tagFile": "danbooru.csv",
+	"activeIn": {
+		"txt2img": true,
+		"img2img": true,
+		"negativePrompts": true
+	},
 	"maxResults": 5,
-	"replaceUnderscores": true
+	"replaceUnderscores": true,
+	"escapeParentheses": true,
+	"colors": {
+		"danbooru": {
+			"0": ["lightblue", "dodgerblue"],
+			"1": ["indianred", "firebrick"],
+			"3": ["violet", "darkorchid"],
+			"4": ["lightgreen", "darkgreen"],
+			"5": ["orange", "darkorange"]
+		},
+		"e621": {
+			"-1": ["red", "maroon"],
+			"0": ["lightblue", "dodgerblue"],
+			"1": ["gold", "goldenrod"],
+			"3": ["violet", "darkorchid"],
+			"4": ["lightgreen", "darkgreen"],
+			"5": ["tomato", "darksalmon"],
+			"6": ["red", "maroon"],
+			"7": ["whitesmoke", "black"],
+			"8": ["seagreen", "darkseagreen"]
+		}
+	}
 }
 ```
 | Setting	| Description |
 |---------|-------------|
 | tagFile | Specifies the tag file to use. You can provide a custom tag database of your liking, but since the script was developed with Danbooru tags in mind, it might not work properly with other configurations.|
+| activeIn | Allows to selectively (de)activate the script for txt2img, img2img, and the negative prompts for both. |
 | maxResults | How many results to show max. For the default tag set, the results are ordered by occurence count. |
 | replaceUnderscores | If true, undescores are replaced with spaces on clicking a tag. Might work better for some models. |
+| escapeParentheses | If true, escapes tags containing () so they don't contribute to the web UI's prompt weighting functionality. |
+| colors | Contains customizable colors for the tag types, you can add new ones here for custom tag files (same name as filename, without the .csv). The first value is for dark, the second for light mode. Color names and hex codes should both work.|
 
 ### CSV tag data
 The script expects a CSV file with tags saved in the following way:
@@ -63,4 +96,17 @@ The numbering system follows the [tag API docs](https://danbooru.donmai.us/wiki_
 |4	    | Character   |
 |5	    | Meta        |
 
+or of e621:
+| Value	| Description |
+|-------|-------------|
+|-1	    | Invalid     |
+|0	    | General     |
+|1	    | Artist      |
+|3	    | Copyright   |
+|4	    | Character   |
+|5	    | Species     |
+|6	    | Invalid     |
+|7	    | Meta        |
+|8	    | Lore        |
+
 The tag type is used for coloring entries in the result list.

tagAutocomplete.js

@@ -1,6 +1,6 @@
 // Style for new elements. Gets appended to the Gradio root.
 const autocompleteCSS_dark = `
-    #autocompleteResults {
+    .autocompleteResults {
         position: absolute;
         z-index: 999;
         margin: 5px 0 0 0;
@@ -9,20 +9,23 @@ const autocompleteCSS_dark = `
         border-radius: 12px !important;
         overflow: hidden;
     }
-    #autocompleteResultsList > li:nth-child(odd) {
+    .autocompleteResultsList > li:nth-child(odd) {
         background-color: #111827;
     }
-    #autocompleteResultsList > li {
+    .autocompleteResultsList > li {
         list-style-type: none;
         padding: 10px;
         cursor: pointer;
     }
-    #autocompleteResultsList > li:hover {
+    .autocompleteResultsList > li:hover {
         background-color: #1f2937;
     }
+    .autocompleteResultsList > li.selected {
+        background-color: #374151;
+    }
 `;
 const autocompleteCSS_light = `
-    #autocompleteResults {
+    .autocompleteResults {
         position: absolute;
         z-index: 999;
         margin: 5px 0 0 0;
@@ -31,17 +34,20 @@ const autocompleteCSS_light = `
         border-radius: 12px !important;
         overflow: hidden;
     }
-    #autocompleteResultsList > li:nth-child(odd) {
+    .autocompleteResultsList > li:nth-child(odd) {
         background-color: #f9fafb;
     }
-    #autocompleteResultsList > li {
+    .autocompleteResultsList > li {
         list-style-type: none;
         padding: 10px;
         cursor: pointer;
     }
-    #autocompleteResultsList > li:hover {
+    .autocompleteResultsList > li:hover {
         background-color: #f5f6f8;
     }
+    .autocompleteResultsList > li.selected {
+        background-color: #e5e7eb;
+    }
 `;
 
 var acConfig = null;
@@ -110,146 +116,302 @@ const debounce = (func, wait = 300) => {
     }
 }
 
+// Difference function to fix duplicates not being seen as changes in normal filter
+function difference(a, b) {
+    if (a.length == 0) {
+        return b;
+    }
+    if (b.length == 0) {
+        return a;
+    }
+
+    return [...b.reduce( (acc, v) => acc.set(v, (acc.get(v) || 0) - 1),
+            a.reduce( (acc, v) => acc.set(v, (acc.get(v) || 0) + 1), new Map() ) 
+    )].reduce( (acc, [v, count]) => acc.concat(Array(Math.abs(count)).fill(v)), [] );
+}
+// Get the identifier for the text area to differentiate between positive and negative
+function getTextAreaIdentifier(textArea) {
+    let txt2img_n = gradioApp().querySelector('#negative_prompt > label > textarea');
+    let img2img = gradioApp().querySelector('#tab_img2img');
+    let img2img_p = img2img.querySelector('#img2img_prompt > label > textarea');
+    let img2img_n = img2img.querySelector('#negative_prompt > label > textarea');
+    
+    let modifier = "";
+    if (textArea === img2img_p || textArea === img2img_n) {
+        modifier += ".img2img";
+    }
+    if (textArea === txt2img_n || textArea === img2img_n) {
+        modifier += ".n";
+    } else {
+        modifier += ".p";
+    }
+    return modifier;
+}
+
 // Create the result list div and necessary styling
-function createResultsDiv() {
+function createResultsDiv(textArea) {
     let resultsDiv = document.createElement("div");
     let resultsList = document.createElement('ul');
     
-    resultsDiv.setAttribute('id', 'autocompleteResults');
-    resultsList.setAttribute('id', 'autocompleteResultsList');
+    let textAreaId = getTextAreaIdentifier(textArea);
+    let typeClass = textAreaId.replaceAll(".", " ");
+
+    resultsDiv.setAttribute('class', `autocompleteResults ${typeClass}`);
+    resultsList.setAttribute('class', 'autocompleteResultsList');
     resultsDiv.appendChild(resultsList);
 
     return resultsDiv;
 }
 
+// The selected tag index. Needs to be up here so hide can access it.
+var selectedTag = null;
+
 // Show or hide the results div
-function showResults() {
-    let resultsDiv = gradioApp().querySelector('#autocompleteResults');
+function isVisible(textArea) {
+    let textAreaId = getTextAreaIdentifier(textArea);
+    let resultsDiv = gradioApp().querySelector('.autocompleteResults' + textAreaId);
+    return resultsDiv.style.display === "block";
+}
+function showResults(textArea) {
+    let textAreaId = getTextAreaIdentifier(textArea);
+
+    let resultsDiv = gradioApp().querySelector('.autocompleteResults' + textAreaId);
     resultsDiv.style.display = "block";
 }
-function hideResults() {
-    let resultsDiv = gradioApp().querySelector('#autocompleteResults');
+function hideResults(textArea) {
+    let textAreaId = getTextAreaIdentifier(textArea);
+
+    let resultsDiv = gradioApp().querySelector('.autocompleteResults' + textAreaId);
     resultsDiv.style.display = "none";
+    selectedTag = null;
 }
 
 // On click, insert the tag into the prompt textbox with respect to the cursor position
-function insertTextAtCursor(text, tagword) {
-    let promptTextbox = gradioApp().querySelector('#txt2img_prompt > label > textarea');
-    let cursorPos = promptTextbox.selectionStart;
+function insertTextAtCursor(textArea, text, tagword) {
+    let cursorPos = textArea.selectionStart;
     let sanitizedText = acConfig.replaceUnderscores ? text.replaceAll("_", " ") : text;
-    let optionalComma = (promptTextbox.value[cursorPos] == ",") ? "" : ", ";
+    sanitizedText = acConfig.escapeParentheses ? sanitizedText.replaceAll("(", "\\(").replaceAll(")", "\\)") : sanitizedText;
+    
+    var prompt = textArea.value;
+    let optionalComma = (prompt[cursorPos] === "," || prompt[cursorPos + tagword.length] === ",") ? "" : ", ";
 
     // Edit prompt text
-    var prompt = promptTextbox.value;
-    promptTextbox.value = prompt.substring(0, cursorPos - tagword.length) + sanitizedText + optionalComma + prompt.substring(cursorPos);
-    prompt = promptTextbox.value;
+    let toRight = prompt.substring(cursorPos, cursorPos + tagword.length) === tagword;
+    if (toRight) {
+        textArea.value = prompt.substring(0, cursorPos) + sanitizedText + optionalComma + prompt.substring(cursorPos + tagword.length)
+        // Update cursor position to after the inserted text
+        textArea.selectionStart = cursorPos + sanitizedText.length + optionalComma.length;
+    } else {
+        textArea.value = prompt.substring(0, cursorPos - tagword.length) + sanitizedText + optionalComma + prompt.substring(cursorPos)
+        textArea.selectionStart = cursorPos - tagword.length + sanitizedText.length + optionalComma.length;
+    }
+    prompt = textArea.value;
+    textArea.selectionEnd = textArea.selectionStart;
 
-    // Update cursor position to after the inserted text
-    promptTextbox.selectionStart = cursorPos + sanitizedText.length;
-    promptTextbox.selectionEnd = promptTextbox.selectionStart;
+    // Since we've modified a Gradio Textbox component manually, we need to simulate an `input` DOM event to ensure its
+    // internal Svelte data binding remains in sync.
+    textArea.dispatchEvent(new Event("input", { bubbles: true }));
 
     // Hide results after inserting
-    hideResults();
+    hideResults(textArea);
 
     // Update previous tags with the edited prompt to prevent re-searching the same term
     let tags = prompt.match(/[^, ]+/g);
     previousTags = tags;
 }
 
-const colors_dark = ["lightblue", "indianred", "unused", "violet", "lightgreen", "orange"];
-const colors_light = ["dodgerblue", "firebrick", "unused", "darkorchid", "darkgreen", "darkorange" ]
-function addResultsToList(results, tagword) {
-    let resultsList = gradioApp().querySelector('#autocompleteResultsList');
+function addResultsToList(textArea, results, tagword) {
+    let textAreaId = getTextAreaIdentifier(textArea);
+    let resultsList = gradioApp().querySelector('.autocompleteResults' + textAreaId + ' > ul');
     resultsList.innerHTML = "";
 
-    let colors = gradioApp().querySelector('.dark') ? colors_dark : colors_light;
+    // Find right colors from config
+    let tagFileName = acConfig.tagFile.split(".")[0];
+    let tagColors = acConfig.colors;
+
+    let mode = gradioApp().querySelector('.dark') ? 0 : 1;
 
     for (let i = 0; i < results.length; i++) {
         let result = results[i];
         let li = document.createElement("li");
         li.innerHTML = result[0];
-        li.style = `color: ${colors[result[1]]};`;
-        li.addEventListener("click", function() { insertTextAtCursor(result[0], tagword); });
+
+        // Set the color of the tag
+        let tagType = result[1];
+        let colorGroup = tagColors[tagFileName];
+        // Default to danbooru scheme if no matching one is found
+        if (colorGroup === undefined) colorGroup = tagColors["danbooru"];
+
+        li.style = `color: ${colorGroup[tagType][mode]};`;
+        // Add listener
+        li.addEventListener("click", function() { insertTextAtCursor(textArea, result[0], tagword); });
+        // Add element to list
         resultsList.appendChild(li);
     }
 }
 
+function updateSelectionStyle(textArea, num) {
+    let textAreaId = getTextAreaIdentifier(textArea);
+    let resultsList = gradioApp().querySelector('.autocompleteResults' + textAreaId + ' > ul');
+    let items = resultsList.getElementsByTagName('li');
+
+    for (let i = 0; i < items.length; i++) {
+        items[i].classList.remove('selected');
+    }
+
+    items[num].classList.add('selected');
+}
+
 allTags = [];
 previousTags = [];
-
-function autocomplete(prompt) {
+results = [];
+tagword = "";
+resultCount = 0;
+function autocomplete(textArea, prompt) {
     // Guard for empty prompt
-    if (prompt.length == 0) {
-        hideResults();
+    if (prompt.length === 0) {
+        hideResults(textArea);
         return;
     }
 
     // Match tags with RegEx to get the last edited one
     let tags = prompt.match(/[^, ]+/g);
-    let difference = tags.filter(x => !previousTags.includes(x));
+    let diff = difference(tags, previousTags)
     previousTags = tags;
 
     // Guard for no difference / only whitespace remaining
-    if (difference == undefined || difference.length == 0) {
-        hideResults();
+    if (diff === undefined || diff.length === 0) {
+        hideResults(textArea);
         return;
     }
 
-    let tagword = difference[0]
+    tagword = diff[0]
 
     // Guard for empty tagword
-    if (tagword == undefined || tagword.length == 0) {
-        hideResults();
+    if (tagword === undefined || tagword.length === 0) {
+        hideResults(textArea);
         return;
     }
     
-    let results = allTags.filter(x => x[0].includes(tagword)).slice(0, acConfig.maxResults);
+    results = allTags.filter(x => x[0].includes(tagword)).slice(0, acConfig.maxResults);
+    resultCount = results.length;
 
     // Guard for empty results
-    if (results.length == 0) {
-        hideResults();
+    if (resultCount === 0) {
+        hideResults(textArea);
         return;
     }
 
-    showResults();
-    addResultsToList(results, tagword);
+    showResults(textArea);
+    addResultsToList(textArea, results, tagword);
+}
+
+function navigateInList(textArea, event) {
+    validKeys = ["ArrowUp", "ArrowDown", "ArrowLeft", "ArrowRight", "Enter", "Escape"];
+
+    if (!validKeys.includes(event.key)) return;
+    if (!isVisible(textArea)) return
+
+    switch (event.key) {
+        case "ArrowUp":
+            if (selectedTag === null) {
+                selectedTag = resultCount - 1;
+            } else {
+                selectedTag = (selectedTag - 1 + resultCount) % resultCount;
+            }
+            break;
+        case "ArrowDown":
+            if (selectedTag === null) {
+                selectedTag = 0;
+            } else {
+                selectedTag = (selectedTag + 1) % resultCount;
+            }
+            break;
+        case "ArrowLeft":
+            selectedTag = 0;
+            break;
+        case "ArrowRight":
+            selectedTag = resultCount - 1;
+            break;
+        case "Enter":
+            if (selectedTag !== null) {
+                insertTextAtCursor(textArea, results[selectedTag][0], tagword);
+            }
+            break;
+        case "Escape":
+            hideResults(textArea);
+            break;
+    }
+    // Update highlighting
+    if (selectedTag !== null)
+        updateSelectionStyle(textArea, selectedTag);
+
+    // Prevent default behavior
+    event.preventDefault();
+    event.stopPropagation();
 }
 
 onUiUpdate(function(){
     // One-time CSV setup
-    if (acConfig == null) acConfig = JSON.parse(readFile("file/tags/config.json"));
-    if (allTags.length == 0) allTags = loadCSV();
+    if (acConfig === null) acConfig = JSON.parse(readFile("file/tags/config.json"));
+    if (allTags.length === 0) allTags = loadCSV();
 
-	let promptTextbox = gradioApp().querySelector('#txt2img_prompt > label > textarea');
-	
-    if (promptTextbox == null) return;
-    if (gradioApp().querySelector('#autocompleteResults') != null) return;
+	let txt2imgTextArea = gradioApp().querySelector('#txt2img_prompt > label > textarea');
+    let img2imgTextArea = gradioApp().querySelector('#img2img_prompt > label > textarea');
+    let negativeTextAreas = Array.from(gradioApp().querySelectorAll('#negative_prompt > label > textarea'));
+    let textAreas = [txt2imgTextArea, img2imgTextArea, negativeTextAreas[0], negativeTextAreas[1]];
 
-    // Only add listeners once
-    if (!promptTextbox.classList.contains('autocomplete')) {
-        // Add our new element
-        var resultsDiv = gradioApp().querySelector('#autocompleteResults') ?? createResultsDiv();
-        promptTextbox.parentNode.insertBefore(resultsDiv, promptTextbox.nextSibling);
-        // Hide by default so it doesn't show up on page load
-        hideResults();
-        
-        // Add autocomplete event listener
-        promptTextbox.addEventListener('input', debounce(() => autocomplete(promptTextbox.value), 100));
-        // Add focusout event listener
-        promptTextbox.addEventListener('focusout', debounce(() => hideResults(), 400));
-
-        // Add class so we know we've already added the listeners
-        promptTextbox.classList.add('autocomplete');
-
-        // Add style to dom
-        let acStyle = document.createElement('style');
-
-        let css = gradioApp().querySelector('.dark') ? autocompleteCSS_dark : autocompleteCSS_light;
-        if (acStyle.styleSheet) {
-            acStyle.styleSheet.cssText = css;
-        } else {
-            acStyle.appendChild(document.createTextNode(css));
-        }
-        gradioApp().appendChild(acStyle);
+    // Not found, we're on a page without prompt textareas
+    if (textAreas.every(v => v === null || v === undefined)) return;
+    // Already added?
+    if (gradioApp().querySelector('.autocompleteResults.p') !== null
+        && (gradioApp().querySelector('.autocompleteResults.n') === null
+            && !acConfig.activeIn.negativePrompts)) {
+        return;
     }
+
+    textAreas.forEach(area => {
+        // Skip directly if not found on the page
+        if (area === null || area === undefined) return;
+        
+        // Return if autocomplete is disabled for the current area type in config
+        let textAreaId = getTextAreaIdentifier(area);
+        if (textAreaId.includes("p") || (textAreaId.includes("n") && acConfig.activeIn.negativePrompts)) {
+            if (textAreaId.includes("img2img")) {
+                if (!acConfig.activeIn.img2img) return;
+            } else {
+                if (!acConfig.activeIn.txt2img) return;
+            }
+        }
+
+        // Only add listeners once
+        if (!area.classList.contains('autocomplete')) {
+            // Add our new element
+            var resultsDiv = createResultsDiv(area);
+            area.parentNode.insertBefore(resultsDiv, area.nextSibling);
+            // Hide by default so it doesn't show up on page load
+            hideResults(area);
+            
+            // Add autocomplete event listener
+            area.addEventListener('input', debounce(() => autocomplete(area, area.value), 100));
+            // Add focusout event listener
+            area.addEventListener('focusout', debounce(() => hideResults(area), 400));
+            // Add up and down arrow event listener
+            area.addEventListener('keydown', (e) => navigateInList(area, e));
+
+            // Add class so we know we've already added the listeners
+            area.classList.add('autocomplete');
+
+            // Add style to dom
+            let acStyle = document.createElement('style');
+
+            let css = gradioApp().querySelector('.dark') ? autocompleteCSS_dark : autocompleteCSS_light;
+            if (acStyle.styleSheet) {
+                acStyle.styleSheet.cssText = css;
+            } else {
+                acStyle.appendChild(document.createTextNode(css));
+            }
+            gradioApp().appendChild(acStyle);
+        }
+    });
 });

tags/config.json

@@ -1,5 +1,31 @@
 {
 	"tagFile": "danbooru.csv",
-	"maxResults": 10,
-	"replaceUnderscores": false
+	"activeIn": {
+		"txt2img": true,
+		"img2img": true,
+		"negativePrompts": true
+	},
+	"maxResults": 5,
+	"replaceUnderscores": true,
+	"escapeParentheses": true,
+	"colors": {
+		"danbooru": {
+			"0": ["lightblue", "dodgerblue"],
+			"1": ["indianred", "firebrick"],
+			"3": ["violet", "darkorchid"],
+			"4": ["lightgreen", "darkgreen"],
+			"5": ["orange", "darkorange"]
+		},
+		"e621": {
+			"-1": ["red", "maroon"],
+			"0": ["lightblue", "dodgerblue"],
+			"1": ["gold", "goldenrod"],
+			"3": ["violet", "darkorchid"],
+			"4": ["lightgreen", "darkgreen"],
+			"5": ["tomato", "darksalmon"],
+			"6": ["red", "maroon"],
+			"7": ["whitesmoke", "black"],
+			"8": ["seagreen", "darkseagreen"]
+		}
+	}
 }