Merge branch 'feature-sort-by-frequent-use'

Merge branch 'main' into feature-sort-by-frequent-use
English dictionary and derpibooru tag lists, thanks to @Nenotriple
2026-01-27 03:29:55 +00:00 · 2024-04-13 15:08:57 +02:00 · 2024-04-13 15:06:53 +02:00 · 2024-04-13 14:42:21 +02:00 · 2024-03-16 16:44:43 +01:00 · 2024-03-03 13:52:32 +01:00
26 changed files with 316821 additions and 84688 deletions
--- a/.gitignore
+++ b/.gitignore
@@ -1,2 +1,3 @@
 tags/temp/
 __pycache__/
+tags/tag_frequency.db
--- a/README.md
+++ b/README.md
@@ -20,6 +20,10 @@ Booru style tag autocompletion for the AUTOMATIC1111 Stable Diffusion WebUI
 </div>
 <br/>

+#### ⚠️ Notice:
+I am currently looking for feedback on a new feature I'm working on and want to release soon.<br/>
+Please check [the announcement post](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/discussions/270) for more info if you are interested to help.
+
 # 📄 Description

 Tag Autocomplete is an extension for the popular [AUTOMATIC1111 web UI](https://github.com/AUTOMATIC1111/stable-diffusion-webui) for Stable Diffusion.
@@ -74,6 +78,10 @@ Wildcard script support:

 https://user-images.githubusercontent.com/34448969/200128031-22dd7c33-71d1-464f-ae36-5f6c8fd49df0.mp4

+Extra Network preview support:
+
+https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/assets/34448969/3c0cad84-fb5f-436d-b05a-28db35860d13
+
 Dark and Light mode supported, including tag colors:

 ![results_dark](https://user-images.githubusercontent.com/34448969/200128214-3b6f21b4-9dda-4acf-820e-5df0285c30d6.png)
@@ -123,6 +131,13 @@ Completion for these types is triggered by typing `<`. By default it will show t
   - Or `<lora:` and `<lyco:` respectively for the long form
 - `<h:` or `<hypernet:` will only show Hypernetworks

+### Live previews
+Tag Autocomplete will now also show the preview images used for the cards in the Extra Networks menu in a small window next to the regular popup.
+This enables quick comparisons and additional info for unclear filenames without having to stop typing to look it up in the webui menu.
+It works for all supported extra network types that use preview images (Loras/Lycos, Embeddings & Hypernetworks). The preview window will stay hidden for normal tags or if no preview was found.
+
+![extra_live_preview](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/assets/34448969/6a5d81e6-b3a0-407b-8bac-c9790f86016c)
+
 ### Lora / Lyco trigger word completion
 This feature will try to add known trigger words on autocompleting a Lora/Lyco.

@@ -307,6 +322,14 @@ If this option is turned on, it will show a `?` link next to the tag. Clicking t

 ![wikiLink](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/assets/34448969/733e1ba8-89e1-4c2b-8c4e-2d23352bd3d7)
 </details>
+<!-- Wiki links -->
+<details>
+<summary>Extra network live previews</summary>
+
+This option enables a small preview window alongside the normal completion popup that will show the card preview also usd in the extra networks tab for that file.
+
+![extraNetworkPreviews](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/assets/34448969/72b5473f-563e-4238-a513-38b60ac87e96)
+</details>
 <!-- Insertion -->
 <details>
 <summary>Completion settings</summary>
@@ -455,7 +478,9 @@ You can also add this to your quicksettings bar to have the refresh button avail

 # Translations
 An additional file can be added in the translation section, which will be used to translate both tags and aliases and also enables searching by translation.
-This file needs to be a CSV in the format `<English tag/alias>,<Translation>`, but for backwards compatibility with older files that used a three column format, you can turn on `Translation file uses old 3-column translation format instead of the new 2-column one` to support them. In that case, the second column will be unused and skipped during parsing.
+This file needs to be a CSV in the format `<English tag/alias>,<Translation>`. Some older files use a three column format, which requires a compatibility setting to be activated.
+You can find it under `Settings > Tag autocomplete > Translation filename > Translation file uses old 3-column translation format instead of the new 2-column one`.
+With it on, the second column will be unused and skipped during parsing.

 Example with Chinese translation:

@@ -465,6 +490,7 @@ Example with Chinese translation:
 ## List of translations
 - [🇨🇳 Chinese tags](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/discussions/23) by @HalfMAI, using machine translation and manual correction for the most common tags (uses legacy format)
 - [🇨🇳 Chinese tags](https://github.com/sgmklp/tag-for-autocompletion-with-translation) by @sgmklp, smaller set of manual translations based on https://github.com/zcyzcy88/TagTable
+- [🇯🇵 Japanese tags](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/discussions/265) by @applemango, both machine and human translations available

 > ### 🫵 I need your help!
 > Translations are a community effort. If you have translated a tag file or want to create one, please open a Pull Request or Issue so your link can be added here.
--- a/README_JA.md
+++ b/README_JA.md
@@ -410,8 +410,9 @@ https://www.w3.org/TR/uievents-key/#named-key-attribute-value
 ![english-input](https://user-images.githubusercontent.com/34448969/200126513-bf6b3940-6e22-41b0-a369-f2b4640f87d6.png)

 ## 翻訳リスト
- [🇨🇳 Chinese tags](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/discussions/23) by @HalfMAI, 最も一般的なタグを機械翻訳と手作業で修正（レガシーフォーマットを使用）
- [🇨🇳 Chinese tags](https://github.com/sgmklp/tag-for-autocompletion-with-translation) by @sgmklp, [こちら](https://github.com/zcyzcy88/TagTable)をベースにして、より小さくした手動での翻訳セット。
+- [🇨🇳 中国語訳](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/discussions/23) by @HalfMAI, 最も一般的なタグを機械翻訳と手作業で修正（レガシーフォーマットを使用）
+- [🇨🇳 中国語訳](https://github.com/sgmklp/tag-for-autocompletion-with-translation) by @sgmklp, [こちら](https://github.com/zcyzcy88/TagTable)をベースにして、より小さくした手動での翻訳セット。
+- [🇯🇵 日本語訳](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/discussions/265) by @applemango, 機械翻訳と人力翻訳の両方が利用可能。

 > ### 🫵 あなたの助けが必要です！
 > 翻訳はコミュニティの努力により支えられています。もしあなたがタグファイルを翻訳したことがある場合、または作成したい場合は、あなたの成果をここに追加できるように、Pull RequestまたはIssueを開いてください。
--- a/README_ZH.md
+++ b/README_ZH.md
@@ -13,6 +13,12 @@
 你可以按照[以下方法](#installation)下载或拷贝文件，也可以使用[Releases](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/releases)中打包好的文件。

 ## 常见问题 & 已知缺陷:
+- 很多中国用户都报告过此扩展名和其他扩展名的 JavaScript 文件被阻止的问题。
+常见的罪魁祸首是 IDM / Internet Download Manager 浏览器插件，它似乎出于安全目的阻止了本地文件请求。
+如果您安装了 IDM，请确保在使用 webui 时禁用以下插件：
+
+    ![image](https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/assets/34448969/d253a4a9-71ab-4b5f-80c4-5aa926fc1fc9)
+
 - 当`replaceUnderscores`选项开启时, 脚本只会替换Tag的一部分如果Tag包含多个单词,比如将`atago (azur lane)`修改`atago`为`taihou`并使用自动补全时.会得到 `taihou (azur lane), lane)`的结果, 因为脚本没有把后面的部分认为成同一个Tag。

 ## 演示与截图
--- a/javascript/__globals.js
+++ b/javascript/__globals.js
@@ -2,6 +2,7 @@
 var TAC_CFG = null;
 var tagBasePath = "";
 var modelKeywordPath = "";
+var tacSelfTrigger = false;

 // Tag completion data loaded from files
 var allTags = [];
@@ -11,12 +12,14 @@ var extras = [];
 var wildcardFiles = [];
 var wildcardExtFiles = [];
 var yamlWildcards = [];
+var umiWildcards = [];
 var embeddings = [];
 var hypernetworks = [];
 var loras = [];
 var lycos = [];
 var modelKeywordDict = new Map();
 var chants = [];
+var styleNames = [];

 // Selected model info for black/whitelisting
 var currentModelHash = "";
@@ -35,6 +38,7 @@ let hideBlocked = false;
 // Tag selection for keyboard navigation
 var selectedTag = null;
 var oldSelectedTag = null;
+var resultCountBeforeNormalTags = 0;

 // Lora keyword undo/redo history
 var textBeforeKeywordInsertion = "";
--- a/javascript/_result.js
+++ b/javascript/_result.js
@@ -8,10 +8,12 @@ const ResultType = Object.freeze({
    "wildcardTag": 4,
    "wildcardFile": 5,
    "yamlWildcard": 6,
-    "hypernetwork": 7,
-    "lora": 8,
-    "lyco": 9,
-    "chant": 10
+    "umiWildcard": 7,
+    "hypernetwork": 8,
+    "lora": 9,
+    "lyco": 10,
+    "chant": 11,
+    "styleName": 12
 });

 // Class to hold result data and annotations to make it clearer to use
@@ -22,10 +24,12 @@ class AutocompleteResult {

    // Additional info, only used in some cases
    category = null;
-    count = null;
+    count = Number.MAX_SAFE_INTEGER;
+    usageBias = null;
    aliases = null;
    meta = null;
    hash = null;
+    sortKey = null;

    // Constructor
    constructor(text, type) {
--- a/javascript/_textAreas.js
+++ b/javascript/_textAreas.js
@@ -9,7 +9,11 @@ const core = [
    "#img2img_prompt > label > textarea",
    "#txt2img_neg_prompt > label > textarea",
    "#img2img_neg_prompt > label > textarea",
-    ".prompt > label > textarea"
+    ".prompt > label > textarea",
+    "#txt2img_edit_style_prompt > label > textarea",
+    "#txt2img_edit_style_neg_prompt > label > textarea",
+    "#img2img_edit_style_prompt > label > textarea",
+    "#img2img_edit_style_neg_prompt > label > textarea"
 ];

 // Third party text area selectors
@@ -57,6 +61,31 @@ const thirdParty = {
            "[id^=MD-i2i][id$=prompt] textarea",
            "[id^=MD-i2i][id$=prompt] input[type='text']"
        ]
+    },
+    "adetailer-t2i": {
+        "base": "#txt2img_script_container",
+        "hasIds": true,
+        "onDemand": true,
+        "selectors": [
+            "[id^=script_txt2img_adetailer_ad_prompt] textarea",
+            "[id^=script_txt2img_adetailer_ad_negative_prompt] textarea"
+        ]
+    },
+    "adetailer-i2i": {
+        "base": "#img2img_script_container",
+        "hasIds": true,
+        "onDemand": true,
+        "selectors": [
+            "[id^=script_img2img_adetailer_ad_prompt] textarea",
+            "[id^=script_img2img_adetailer_ad_negative_prompt] textarea"
+        ]
+    },
+    "deepdanbooru-object-recognition": {
+        "base": "#tab_deepdanboru_object_recg_tab",
+        "hasIds": false,
+        "selectors": [
+            "Found tags",
+        ]
    }
 }

@@ -90,7 +119,7 @@ function addOnDemandObservers(setupFunction) {

        let base = gradioApp().querySelector(entry.base);
        if (!base) continue;
-        
+
        let accordions = [...base?.querySelectorAll(".gradio-accordion")];
        if (!accordions) continue;

@@ -115,12 +144,12 @@ function addOnDemandObservers(setupFunction) {
                            [...gradioApp().querySelectorAll(entry.selectors.join(", "))].forEach(x => setupFunction(x));
                        } else { // Otherwise, we have to find the text areas by their adjacent labels
                            let base = gradioApp().querySelector(entry.base);
-                
+
                            // Safety check
                            if (!base) continue;
-                
+
                            let allTextAreas = [...base.querySelectorAll("textarea, input[type='text']")];
-                
+
                            // Filter the text areas where the adjacent label matches one of the selectors
                            let matchingTextAreas = allTextAreas.filter(ta => [...ta.parentElement.childNodes].some(x => entry.selectors.includes(x.innerText)));
                            matchingTextAreas.forEach(x => setupFunction(x));
@@ -165,4 +194,4 @@ function getTextAreaIdentifier(textArea) {
            break;
    }
    return modifier;
-}
+}
--- a/javascript/_utils.js
+++ b/javascript/_utils.js
@@ -1,13 +1,14 @@
 // Utility functions for tag autocomplete

 // Parse the CSV file into a 2D array. Doesn't use regex, so it is very lightweight.
+// We are ignoring newlines in quote fields since we expect one-line entries and parsing would break for unclosed quotes otherwise
 function parseCSV(str) {
-    var arr = [];
-    var quote = false;  // 'true' means we're inside a quoted field
+    const arr = [];
+    let quote = false;  // 'true' means we're inside a quoted field

    // Iterate over each character, keep track of current row and column (of the returned array)
-    for (var row = 0, col = 0, c = 0; c < str.length; c++) {
-        var cc = str[c], nc = str[c + 1];        // Current character, next character
+    for (let row = 0, col = 0, c = 0; c < str.length; c++) {
+        let cc = str[c], nc = str[c+1];        // Current character, next character
        arr[row] = arr[row] || [];             // Create a new row if necessary
        arr[row][col] = arr[row][col] || '';   // Create a new column (start with empty string) if necessary

@@ -22,14 +23,12 @@ function parseCSV(str) {
        // If it's a comma and we're not in a quoted field, move on to the next column
        if (cc == ',' && !quote) { ++col; continue; }

-        // If it's a newline (CRLF) and we're not in a quoted field, skip the next character
-        // and move on to the next row and move to column 0 of that new row
-        if (cc == '\r' && nc == '\n' && !quote) { ++row; col = 0; ++c; continue; }
+        // If it's a newline (CRLF), skip the next character and move on to the next row and move to column 0 of that new row
+        if (cc == '\r' && nc == '\n') { ++row; col = 0; ++c; quote = false; continue; }

-        // If it's a newline (LF or CR) and we're not in a quoted field,
-        // move on to the next row and move to column 0 of that new row
-        if (cc == '\n' && !quote) { ++row; col = 0; continue; }
-        if (cc == '\r' && !quote) { ++row; col = 0; continue; }
+        // If it's a newline (LF or CR) move on to the next row and move to column 0 of that new row
+        if (cc == '\n') { ++row; col = 0; quote = false; continue; }
+        if (cc == '\r') { ++row; col = 0; quote = false; continue; }

        // Otherwise, append the current character to the current column
        arr[row][col] += cc;
@@ -41,7 +40,7 @@ function parseCSV(str) {
 async function readFile(filePath, json = false, cache = false) {
    if (!cache)
        filePath += `?${new Date().getTime()}`;
-        
+
    let response = await fetch(`file=${filePath}`);

    if (response.status != 200) {
@@ -81,6 +80,72 @@ async function fetchAPI(url, json = true, cache = false) {
        return await response.text();
 }

+async function postAPI(url, body = null) {
+    let response = await fetch(url, {
+        method: "POST",
+        headers: {'Content-Type': 'application/json'},
+        body: body
+    });
+
+    if (response.status != 200) {
+        console.error(`Error posting to API endpoint "${url}": ` + response.status, response.statusText);
+        return null;
+    }
+
+    return await response.json();
+}
+
+async function putAPI(url, body = null) {
+    let response = await fetch(url, { method: "PUT", body: body });
+    
+    if (response.status != 200) {
+        console.error(`Error putting to API endpoint "${url}": ` + response.status, response.statusText);
+        return null;
+    }
+
+    return await response.json();
+}
+
+// Extra network preview thumbnails
+async function getExtraNetworkPreviewURL(filename, type) {
+    const previewJSON = await fetchAPI(`tacapi/v1/thumb-preview/${filename}?type=${type}`, true, true);
+    if (previewJSON?.url) {
+        const properURL = `sd_extra_networks/thumb?filename=${previewJSON.url}`;
+        if ((await fetch(properURL)).status == 200) {
+            return properURL;
+        } else {
+            // create blob url
+            const blob = await (await fetch(`tacapi/v1/thumb-preview-blob/${filename}?type=${type}`)).blob();
+            return URL.createObjectURL(blob);
+        }
+    } else {
+        return null;
+    }
+}
+
+lastStyleRefresh = 0;
+// Refresh style file if needed
+async function refreshStyleNamesIfChanged() {
+    // Only refresh once per second
+    currentTimestamp = new Date().getTime();
+    if (currentTimestamp - lastStyleRefresh < 1000) return;
+    lastStyleRefresh = currentTimestamp;
+
+    const response = await fetch(`tacapi/v1/refresh-styles-if-changed?${new Date().getTime()}`)
+    if (response.status === 304) {
+        // Not modified
+    } else if (response.status === 200) {
+        // Reload
+        QUEUE_FILE_LOAD.forEach(async fn => {
+            if (fn.toString().includes("styleNames"))
+                await fn.call(null, true);
+        })
+    } else {
+        // Error
+        console.error(`Error refreshing styles.txt: ` + response.status, response.statusText);
+    }
+}
+
 // Debounce function to prevent spamming the autocomplete function
 var dbTimeOut;
 const debounce = (func, wait = 300) => {
@@ -109,6 +174,126 @@ function difference(a, b) {
    )].reduce((acc, [v, count]) => acc.concat(Array(Math.abs(count)).fill(v)), []);
 }

+// Object flatten function adapted from https://stackoverflow.com/a/61602592
+// $roots keeps previous parent properties as they will be added as a prefix for each prop.
+// $sep is just a preference if you want to seperate nested paths other than dot.
+function flatten(obj, roots = [], sep = ".") {
+  return Object.keys(obj).reduce(
+    (memo, prop) =>
+      Object.assign(
+        // create a new object
+        {},
+        // include previously returned object
+        memo,
+        Object.prototype.toString.call(obj[prop]) === "[object Object]"
+          ? // keep working if value is an object
+            flatten(obj[prop], roots.concat([prop]), sep)
+          : // include current prop and value and prefix prop with the roots
+            { [roots.concat([prop]).join(sep)]: obj[prop] }
+      ),
+    {}
+  );
+}
+
+// Calculate biased tag score based on post count and frequent usage
+function calculateUsageBias(result, count, uses) {
+    // Check setting conditions
+    if (uses < TAC_CFG.frequencyMinCount) {
+        uses = 0;
+    } else if (uses != 0) {
+        result.usageBias = true;
+    }
+
+    switch (TAC_CFG.frequencyFunction) {
+        case "Logarithmic (weak)":
+            return Math.log(1 + count) + Math.log(1 + uses);
+        case "Logarithmic (strong)":
+            return Math.log(1 + count) + 2 * Math.log(1 + uses);
+        case "Usage first":
+            return uses;
+        default:
+            return count;
+    }
+}
+// Beautify return type for easier parsing
+function mapUseCountArray(useCounts, posAndNeg = false) {
+    return useCounts.map(useCount => {
+        if (posAndNeg) {
+            return {
+                "name": useCount[0],
+                "type": useCount[1],
+                "count": useCount[2],
+                "negCount": useCount[3],
+                "lastUseDate": useCount[4]
+            }
+        }
+        return {
+            "name": useCount[0],
+            "type": useCount[1],
+            "count": useCount[2],
+            "lastUseDate": useCount[3]
+        }
+    });
+}
+// Call API endpoint to increase bias of tag in the database
+function increaseUseCount(tagName, type, negative = false) {
+    postAPI(`tacapi/v1/increase-use-count?tagname=${tagName}&ttype=${type}&neg=${negative}`);
+}
+// Get use count of tag from the database
+async function getUseCount(tagName, type, negative = false) {
+    return (await fetchAPI(`tacapi/v1/get-use-count?tagname=${tagName}&ttype=${type}&neg=${negative}`, true, false))["result"];
+}
+async function getUseCounts(tagNames, types, negative = false) {
+    // While semantically weird, we have to use POST here for the body, as urls are limited in length
+    const body = JSON.stringify({"tagNames": tagNames, "tagTypes": types, "neg": negative});
+    const rawArray = (await postAPI(`tacapi/v1/get-use-count-list`, body))["result"]
+    return mapUseCountArray(rawArray);
+}
+async function getAllUseCounts() {
+    const rawArray = (await fetchAPI(`tacapi/v1/get-all-use-counts`))["result"];
+    return mapUseCountArray(rawArray, true);
+}
+async function resetUseCount(tagName, type, resetPosCount, resetNegCount) {
+    await putAPI(`tacapi/v1/reset-use-count?tagname=${tagName}&ttype=${type}&pos=${resetPosCount}&neg=${resetNegCount}`);
+}
+
+function createTagUsageTable(tagCounts) {
+    // Create table
+    let tagTable = document.createElement("table");
+    tagTable.innerHTML =
+    `<thead>
+        <tr>
+            <td>Name</td>
+            <td>Type</td>
+            <td>Count(+)</td>
+            <td>Count(-)</td>
+            <td>Last used</td>
+        </tr>
+    </thead>`;
+    tagTable.id = "tac_tagUsageTable"
+
+    tagCounts.forEach(t => {
+        let tr = document.createElement("tr");
+        
+        // Fill values
+        let values = [t.name, t.type-1, t.count, t.negCount, t.lastUseDate]
+        values.forEach(v => {
+            let td = document.createElement("td");
+            td.innerText = v;
+            tr.append(td);
+        });
+        // Add delete/reset button
+        let delButton = document.createElement("button");
+        delButton.innerText = "🗑️";
+        delButton.title = "Reset count";
+        tr.append(delButton);
+        
+        tagTable.append(tr)
+    });
+
+    return tagTable;
+}
+
 // Sliding window function to get possible combination groups of an array
 function toNgrams(inputArray, size) {
    return Array.from(
@@ -117,7 +302,11 @@ function toNgrams(inputArray, size) {
    );
 }

-function escapeRegExp(string) {
+function escapeRegExp(string, wildcardMatching = false) {
+    if (wildcardMatching) {
+        // Escape all characters except asterisks and ?, which should be treated separately as placeholders.
+        return string.replace(/[-[\]{}()+.,\\^$|#\s]/g, '\\$&').replace(/\*/g, '.*').replace(/\?/g, '.');
+    }
    return string.replace(/[.*+?^${}()|[\]\\]/g, '\\$&'); // $& means the whole matched string
 }
 function escapeHTML(unsafeText) {
@@ -161,6 +350,49 @@ function observeElement(element, property, callback, delay = 0) {
    }
 }

+// Sort functions
+function getSortFunction() {
+    let criterion = TAC_CFG.modelSortOrder || "Name";
+
+    const textSort = (a, b, reverse = false) => {
+        // Assign keys so next sort is faster
+        if (!a.sortKey) {
+            a.sortKey = a.type === ResultType.chant
+                ? a.aliases
+                : a.text;
+        }
+        if (!b.sortKey) {
+            b.sortKey = b.type === ResultType.chant
+                ? b.aliases
+                : b.text;
+        }
+
+        return reverse ? b.sortKey.localeCompare(a.sortKey) : a.sortKey.localeCompare(b.sortKey);
+    }
+    const numericSort = (a, b, reverse = false) => {
+        const noKey = reverse ? "-1" : Number.MAX_SAFE_INTEGER;
+        let aParsed = parseFloat(a.sortKey || noKey);
+        let bParsed = parseFloat(b.sortKey || noKey);
+
+        if (aParsed === bParsed) {
+            return textSort(a, b, false);
+        }
+        
+        return reverse ? bParsed - aParsed : aParsed - bParsed;
+    }
+
+    return (a, b) => {
+        switch (criterion) {
+            case "Date Modified (newest first)":
+                return numericSort(a, b, true);
+            case "Date Modified (oldest first)":
+                return numericSort(a, b, false);
+            default:
+                return textSort(a, b);
+        }
+    }
+}
+
 // Queue calling function to process global queues
 async function processQueue(queue, context, ...args) {
    for (let i = 0; i < queue.length; i++) {
--- a/javascript/ext_chants.js
+++ b/javascript/ext_chants.js
@@ -7,7 +7,10 @@ class ChantParser extends BaseTagParser {
        let tempResults = [];
        if (tagword !== "<" && tagword !== "<c:") {
            let searchTerm = tagword.replace("<chant:", "").replace("<c:", "").replace("<", "");
-            let filterCondition = x => x.terms.toLowerCase().includes(searchTerm) || x.name.toLowerCase().includes(searchTerm);
+            let filterCondition = x => {
+                let regex = new RegExp(escapeRegExp(searchTerm, true), 'i');
+                return regex.test(x.terms.toLowerCase()) || regex.test(x.name.toLowerCase());
+            };
            tempResults = chants.filter(x => filterCondition(x)); // Filter by tagword
        } else {
            tempResults = chants;
@@ -41,7 +44,7 @@ async function load() {

 function sanitize(tagType, text) {
    if (tagType === ResultType.chant) {
-        return text.replace(/^.*?: /g, "");
+        return text;
    }
    return null;
 }
@@ -51,4 +54,4 @@ PARSERS.push(new ChantParser(CHANT_TRIGGER));
 // Add our utility functions to their respective queues
 QUEUE_FILE_LOAD.push(load);
 QUEUE_SANITIZE.push(sanitize);
-QUEUE_AFTER_CONFIG_CHANGE.push(load);
+QUEUE_AFTER_CONFIG_CHANGE.push(load);
--- a/javascript/ext_embeddings.js
+++ b/javascript/ext_embeddings.js
@@ -1,5 +1,5 @@
 const EMB_REGEX = /<(?!l:|h:|c:)[^,> ]*>?/g;
-const EMB_TRIGGER = () => TAC_CFG.useEmbeddings && tagword.match(EMB_REGEX);
+const EMB_TRIGGER = () => TAC_CFG.useEmbeddings && (tagword.match(EMB_REGEX) || TAC_CFG.includeEmbeddingsInNormalResults);

 class EmbeddingParser extends BaseTagParser {
    parse() {
@@ -11,12 +11,18 @@ class EmbeddingParser extends BaseTagParser {
            if (searchTerm.startsWith("v1") || searchTerm.startsWith("v2")) {
                versionString = searchTerm.slice(0, 2);
                searchTerm = searchTerm.slice(2);
+            } else if (searchTerm.startsWith("vxl")) {
+                versionString = searchTerm.slice(0, 3);
+                searchTerm = searchTerm.slice(3);
            }

-            let filterCondition = x => x[0].toLowerCase().includes(searchTerm) || x[0].toLowerCase().replaceAll(" ", "_").includes(searchTerm);
+            let filterCondition = x => {
+                let regex = new RegExp(escapeRegExp(searchTerm, true), 'i');
+                return regex.test(x[0].toLowerCase()) || regex.test(x[0].toLowerCase().replaceAll(" ", "_"));
+            };

            if (versionString)
-                tempResults = embeddings.filter(x => filterCondition(x) && x[1] && x[1] === versionString); // Filter by tagword
+                tempResults = embeddings.filter(x => filterCondition(x) && x[2] && x[2].toLowerCase() === versionString.toLowerCase()); // Filter by tagword
            else
                tempResults = embeddings.filter(x => filterCondition(x)); // Filter by tagword
        } else {
@@ -26,8 +32,13 @@ class EmbeddingParser extends BaseTagParser {
        // Add final results
        let finalResults = [];
        tempResults.forEach(t => {
-            let result = new AutocompleteResult(t[0].trim(), ResultType.embedding)
-            result.meta = t[1] + " Embedding";
+            let lastDot = t[0].lastIndexOf(".") > -1 ? t[0].lastIndexOf(".") : t[0].length;
+            let lastSlash = t[0].lastIndexOf("/") > -1 ? t[0].lastIndexOf("/") : -1;
+            let name = t[0].trim().substring(lastSlash + 1, lastDot);
+
+            let result = new AutocompleteResult(name, ResultType.embedding)
+            result.sortKey = t[1];
+            result.meta = t[2] + " Embedding";
            finalResults.push(result);
        });

@@ -38,9 +49,9 @@ class EmbeddingParser extends BaseTagParser {
 async function load() {
    if (embeddings.length === 0) {
        try {
-            embeddings = (await readFile(`${tagBasePath}/temp/emb.txt`)).split("\n")
-                .filter(x => x.trim().length > 0) // Remove empty lines
-                .map(x => x.trim().split(",")); // Split into name, version type pairs
+            embeddings = (await loadCSV(`${tagBasePath}/temp/emb.txt`))
+                .filter(x => x[0]?.trim().length > 0) // Remove empty lines
+                .map(x => [x[0].trim(), x[1], x[2]]); // Return name, sortKey, hash tuples
        } catch (e) {
            console.error("Error loading embeddings.txt: " + e);
        }
@@ -49,7 +60,7 @@ async function load() {

 function sanitize(tagType, text) {
    if (tagType === ResultType.embedding) {
-        return text.replace(/^.*?: /g, "");
+        return text;
    }
    return null;
 }
@@ -58,4 +69,4 @@ PARSERS.push(new EmbeddingParser(EMB_TRIGGER));

 // Add our utility functions to their respective queues
 QUEUE_FILE_LOAD.push(load);
-QUEUE_SANITIZE.push(sanitize);
+QUEUE_SANITIZE.push(sanitize);
--- a/javascript/ext_hypernets.js
+++ b/javascript/ext_hypernets.js
@@ -7,8 +7,11 @@ class HypernetParser extends BaseTagParser {
        let tempResults = [];
        if (tagword !== "<" && tagword !== "<h:" && tagword !== "<hypernet:") {
            let searchTerm = tagword.replace("<hypernet:", "").replace("<h:", "").replace("<", "");
-            let filterCondition = x => x.toLowerCase().includes(searchTerm) || x.toLowerCase().replaceAll(" ", "_").includes(searchTerm);
-            tempResults = hypernetworks.filter(x => filterCondition(x)); // Filter by tagword
+            let filterCondition = x => {
+                let regex = new RegExp(escapeRegExp(searchTerm, true), 'i');
+                return regex.test(x.toLowerCase()) || regex.test(x.toLowerCase().replaceAll(" ", "_"));
+            };
+            tempResults = hypernetworks.filter(x => filterCondition(x[0])); // Filter by tagword
        } else {
            tempResults = hypernetworks;
        }
@@ -16,8 +19,9 @@ class HypernetParser extends BaseTagParser {
        // Add final results
        let finalResults = [];
        tempResults.forEach(t => {
-            let result = new AutocompleteResult(t.trim(), ResultType.hypernetwork)
+            let result = new AutocompleteResult(t[0].trim(), ResultType.hypernetwork)
            result.meta = "Hypernetwork";
+            result.sortKey = t[1];
            finalResults.push(result);
        });

@@ -28,9 +32,9 @@ class HypernetParser extends BaseTagParser {
 async function load() {
    if (hypernetworks.length === 0) {
        try {
-            hypernetworks = (await readFile(`${tagBasePath}/temp/hyp.txt`)).split("\n")
-                .filter(x => x.trim().length > 0) //Remove empty lines
-                .map(x => x.trim()); // Remove carriage returns and padding if it exists
+            hypernetworks = (await loadCSV(`${tagBasePath}/temp/hyp.txt`))
+                .filter(x => x[0]?.trim().length > 0) //Remove empty lines
+                .map(x => [x[0]?.trim(), x[1]]); // Remove carriage returns and padding if it exists
        } catch (e) {
            console.error("Error loading hypernetworks.txt: " + e);
        }
@@ -48,4 +52,4 @@ PARSERS.push(new HypernetParser(HYP_TRIGGER));

 // Add our utility functions to their respective queues
 QUEUE_FILE_LOAD.push(load);
-QUEUE_SANITIZE.push(sanitize);
+QUEUE_SANITIZE.push(sanitize);
--- a/javascript/ext_loras.js
+++ b/javascript/ext_loras.js
@@ -7,7 +7,10 @@ class LoraParser extends BaseTagParser {
        let tempResults = [];
        if (tagword !== "<" && tagword !== "<l:" && tagword !== "<lora:") {
            let searchTerm = tagword.replace("<lora:", "").replace("<l:", "").replace("<", "");
-            let filterCondition = x => x.toLowerCase().includes(searchTerm) || x.toLowerCase().replaceAll(" ", "_").includes(searchTerm);
+            let filterCondition = x => {
+                let regex = new RegExp(escapeRegExp(searchTerm, true), 'i');
+                return regex.test(x.toLowerCase()) || regex.test(x.toLowerCase().replaceAll(" ", "_"));
+            };
            tempResults = loras.filter(x => filterCondition(x[0])); // Filter by tagword
        } else {
            tempResults = loras;
@@ -16,9 +19,15 @@ class LoraParser extends BaseTagParser {
        // Add final results
        let finalResults = [];
        tempResults.forEach(t => {
-            let result = new AutocompleteResult(t[0].trim(), ResultType.lora)
+            const text = t[0].trim();
+            let lastDot = text.lastIndexOf(".") > -1 ? text.lastIndexOf(".") : text.length;
+            let lastSlash = text.lastIndexOf("/") > -1 ? text.lastIndexOf("/") : -1;
+            let name = text.substring(lastSlash + 1, lastDot);
+
+            let result = new AutocompleteResult(name, ResultType.lora)
            result.meta = "Lora";
-            result.hash = t[1];
+            result.sortKey = t[1];
+            result.hash = t[2];
            finalResults.push(result);
        });

@@ -31,7 +40,7 @@ async function load() {
        try {
            loras = (await loadCSV(`${tagBasePath}/temp/lora.txt`))
                .filter(x => x[0]?.trim().length > 0) // Remove empty lines
-                .map(x => [x[0]?.trim(), x[1]]); // Trim filenames and return the name, hash pairs
+                .map(x => [x[0]?.trim(), x[1], x[2]]); // Trim filenames and return the name, sortKey, hash pairs
        } catch (e) {
            console.error("Error loading lora.txt: " + e);
        }
@@ -46,11 +55,7 @@ async function sanitize(tagType, text) {
            multiplier = info["preferred weight"];
        }

-        const lastDot = text.lastIndexOf(".");
-        const lastSlash = text.lastIndexOf("/");
-        const name = text.substring(lastSlash + 1, lastDot);
-
-        return `<lora:${name}:${multiplier}>`;
+        return `<lora:${text}:${multiplier}>`;
    }
    return null;
 }
@@ -59,4 +64,4 @@ PARSERS.push(new LoraParser(LORA_TRIGGER));

 // Add our utility functions to their respective queues
 QUEUE_FILE_LOAD.push(load);
-QUEUE_SANITIZE.push(sanitize);
+QUEUE_SANITIZE.push(sanitize);
--- a/javascript/ext_lycos.js
+++ b/javascript/ext_lycos.js
@@ -5,9 +5,12 @@ class LycoParser extends BaseTagParser {
    parse() {
        // Show lyco
        let tempResults = [];
-        if (tagword !== "<" && tagword !== "<l:" && tagword !== "<lyco:") {
-            let searchTerm = tagword.replace("<lyco:", "").replace("<l:", "").replace("<", "");
-            let filterCondition = x => x.toLowerCase().includes(searchTerm) || x.toLowerCase().replaceAll(" ", "_").includes(searchTerm);
+        if (tagword !== "<" && tagword !== "<l:" && tagword !== "<lyco:" && tagword !== "<lora:") {
+            let searchTerm = tagword.replace("<lyco:", "").replace("<lora:", "").replace("<l:", "").replace("<", "");
+            let filterCondition = x => {
+                let regex = new RegExp(escapeRegExp(searchTerm, true), 'i');
+                return regex.test(x.toLowerCase()) || regex.test(x.toLowerCase().replaceAll(" ", "_"));
+            };
            tempResults = lycos.filter(x => filterCondition(x[0])); // Filter by tagword
        } else {
            tempResults = lycos;
@@ -16,9 +19,15 @@ class LycoParser extends BaseTagParser {
        // Add final results
        let finalResults = [];
        tempResults.forEach(t => {
-            let result = new AutocompleteResult(t[0].trim(), ResultType.lyco)
+            const text = t[0].trim();
+            let lastDot = text.lastIndexOf(".") > -1 ? text.lastIndexOf(".") : text.length;
+            let lastSlash = text.lastIndexOf("/") > -1 ? text.lastIndexOf("/") : -1;
+            let name = text.substring(lastSlash + 1, lastDot);
+
+            let result = new AutocompleteResult(name, ResultType.lyco)
            result.meta = "Lyco";
-            result.hash = t[1];
+            result.sortKey = t[1];
+            result.hash = t[2];
            finalResults.push(result);
        });

@@ -31,7 +40,7 @@ async function load() {
        try {
            lycos = (await loadCSV(`${tagBasePath}/temp/lyco.txt`))
                .filter(x => x[0]?.trim().length > 0) // Remove empty lines
-                .map(x => [x[0]?.trim(), x[1]]); // Trim filenames and return the name, hash pairs
+                .map(x => [x[0]?.trim(), x[1], x[2]]); // Trim filenames and return the name, sortKey, hash pairs
        } catch (e) {
            console.error("Error loading lyco.txt: " + e);
        }
@@ -46,11 +55,8 @@ async function sanitize(tagType, text) {
            multiplier = info["preferred weight"];
        }

-        const lastDot = text.lastIndexOf(".");
-        const lastSlash = text.lastIndexOf("/");
-        const name = text.substring(lastSlash + 1, lastDot);
-
-        return `<lyco:${name}:${multiplier}>`;
+        let prefix = TAC_CFG.useLoraPrefixForLycos ? "lora" : "lyco";
+        return `<${prefix}:${text}:${multiplier}>`;
    }
    return null;
 }
@@ -59,4 +65,4 @@ PARSERS.push(new LycoParser(LYCO_TRIGGER));

 // Add our utility functions to their respective queues
 QUEUE_FILE_LOAD.push(load);
-QUEUE_SANITIZE.push(sanitize);
+QUEUE_SANITIZE.push(sanitize);
--- a/javascript/ext_modelKeyword.js
+++ b/javascript/ext_modelKeyword.js
@@ -20,7 +20,7 @@ async function load() {
            // Add to the dict
            csv_lines.forEach(parts => {
                const hash = parts[0];
-                const keywords = parts[1].replaceAll("| ", ", ").replaceAll("|", ", ").trim();
+                const keywords = parts[1]?.replaceAll("| ", ", ")?.replaceAll("|", ", ")?.trim();
                const lastSepIndex = parts[2]?.lastIndexOf("/") + 1 || parts[2]?.lastIndexOf("\\") + 1 || 0;
                const name = parts[2]?.substring(lastSepIndex).trim() || "none"

--- a/javascript/ext_styles.js
+++ b/javascript/ext_styles.js
@@ -0,0 +1,70 @@
+const STYLE_REGEX = /(\$(\d*)\(?)[^$|\[\],\s]*\)?/;
+const STYLE_TRIGGER = () => TAC_CFG.useStyleVars && tagword.match(STYLE_REGEX);
+
+var lastStyleVarIndex = "";
+
+class StyleParser extends BaseTagParser {
+   async parse() {
+        // Refresh if needed
+        await refreshStyleNamesIfChanged();
+
+        // Show styles
+        let tempResults = [];
+        let matchGroups = tagword.match(STYLE_REGEX);
+        
+        // Save index to insert again later or clear last one
+        lastStyleVarIndex = matchGroups[2] ? matchGroups[2] : "";
+
+        if (tagword !== matchGroups[1]) {
+            let searchTerm = tagword.replace(matchGroups[1], "");
+            
+            let filterCondition = x => {
+                let regex = new RegExp(escapeRegExp(searchTerm, true), 'i');
+                return regex.test(x[0].toLowerCase()) || regex.test(x[0].toLowerCase().replaceAll(" ", "_"));
+            };
+            tempResults = styleNames.filter(x => filterCondition(x)); // Filter by tagword
+        } else {
+            tempResults = styleNames;
+        }
+
+        // Add final results
+        let finalResults = [];
+        tempResults.forEach(t => {
+            let result = new AutocompleteResult(t[0].trim(), ResultType.styleName)
+            result.meta = "Style";
+            finalResults.push(result);
+        });
+
+        return finalResults;
+    }
+}
+
+async function load(force = false) {
+    if (styleNames.length === 0 || force) {
+        try {
+            styleNames = (await loadCSV(`${tagBasePath}/temp/styles.txt`))
+                .filter(x => x[0]?.trim().length > 0) // Remove empty lines
+                .filter(x => x[0] !== "None") // Remove "None" style
+                .map(x => [x[0].trim()]); // Trim name
+        } catch (e) {
+            console.error("Error loading styles.txt: " + e);
+        }
+    }
+}
+
+function sanitize(tagType, text) {
+    if (tagType === ResultType.styleName) {
+        if (text.includes(" ")) {
+            return `$${lastStyleVarIndex}(${text})`;
+        } else {
+            return`$${lastStyleVarIndex}${text}`
+        }
+    }
+    return null;
+}
+
+PARSERS.push(new StyleParser(STYLE_TRIGGER));
+
+// Add our utility functions to their respective queues
+QUEUE_FILE_LOAD.push(load);
+QUEUE_SANITIZE.push(sanitize);
--- a/javascript/ext_umi.js
+++ b/javascript/ext_umi.js
@@ -7,7 +7,7 @@ class UmiParser extends BaseTagParser {
    parse(textArea, prompt) {
        // We are in a UMI yaml tag definition, parse further
        let umiSubPrompts = [...prompt.matchAll(UMI_PROMPT_REGEX)];
-                
+
        let umiTags = [];
        let umiTagsWithOperators = []

@@ -15,7 +15,7 @@ class UmiParser extends BaseTagParser {

        umiSubPrompts.forEach(umiSubPrompt => {
            umiTags = umiTags.concat([...umiSubPrompt[0].matchAll(UMI_TAG_REGEX)].map(x => x[1].toLowerCase()));
-            
+
            const start = umiSubPrompt.index;
            const end = umiSubPrompt.index + umiSubPrompt[0].length;
            if (textArea.selectionStart >= start && textArea.selectionStart <= end) {
@@ -74,7 +74,7 @@ class UmiParser extends BaseTagParser {
        //console.log({ matches })

        const filteredWildcards = (tagword) => {
-            const wildcards = yamlWildcards.filter(x => {
+            const wildcards = umiWildcards.filter(x => {
                let tags = x[1];
                const matchesNeg =
                    matches.negative.length === 0
@@ -113,7 +113,7 @@ class UmiParser extends BaseTagParser {
                    || !matches.all.includes(x[0])
                );
        }
-        
+
        if (umiTags.length > 0) {
            // Get difference for subprompt
            let tagCountChange = umiTags.length - umiPreviousTags.length;
@@ -129,7 +129,7 @@ class UmiParser extends BaseTagParser {
                return;
            }

-            let umiTagword = diff[0] || '';
+            let umiTagword = tagCountChange < 0 ? '' : diff[0] || '';
            let tempResults = [];
            if (umiTagword && umiTagword.length > 0) {
                umiTagword = umiTagword.toLowerCase().replace(/[\n\r]/g, "");
@@ -144,48 +144,53 @@ class UmiParser extends BaseTagParser {
                // Add final results
                let finalResults = [];
                tempResults.forEach(t => {
-                    let result = new AutocompleteResult(t[0].trim(), ResultType.yamlWildcard)
+                    let result = new AutocompleteResult(t[0].trim(), ResultType.umiWildcard)
                    result.count = t[1];
                    finalResults.push(result);
                });

+                finalResults = finalResults.sort((a, b) => b.count - a.count);
                return finalResults;
            } else if (showAll) {
                let filteredWildcardsSorted = filteredWildcards("");
-                
+
                // Add final results
                let finalResults = [];
                filteredWildcardsSorted.forEach(t => {
-                    let result = new AutocompleteResult(t[0].trim(), ResultType.yamlWildcard)
+                    let result = new AutocompleteResult(t[0].trim(), ResultType.umiWildcard)
                    result.count = t[1];
                    finalResults.push(result);
                });
-        
+
                originalTagword = tagword;
                tagword = "";
+
+                finalResults = finalResults.sort((a, b) => b.count - a.count);
                return finalResults;
            }
        } else {
            let filteredWildcardsSorted = filteredWildcards("");
-                
+
            // Add final results
            let finalResults = [];
            filteredWildcardsSorted.forEach(t => {
-                let result = new AutocompleteResult(t[0].trim(), ResultType.yamlWildcard)
+                let result = new AutocompleteResult(t[0].trim(), ResultType.umiWildcard)
                result.count = t[1];
                finalResults.push(result);
            });

            originalTagword = tagword;
            tagword = "";
+
+            finalResults = finalResults.sort((a, b) => b.count - a.count);
            return finalResults;
        }
    }
 }

-function updateUmiTags( tagType, sanitizedText, newPrompt, textArea) {
-    // If it was a yaml wildcard, also update the umiPreviousTags
-    if (tagType === ResultType.yamlWildcard && originalTagword.length > 0) {
+function updateUmiTags(tagType, sanitizedText, newPrompt, textArea) {
+    // If it was a umi wildcard, also update the umiPreviousTags
+    if (tagType === ResultType.umiWildcard && originalTagword.length > 0) {
        let umiSubPrompts = [...newPrompt.matchAll(UMI_PROMPT_REGEX)];

        let umiTags = [];
@@ -203,11 +208,11 @@ function updateUmiTags( tagType, sanitizedText, newPrompt, textArea) {
 }

 async function load() {
-    if (yamlWildcards.length === 0) {
+    if (umiWildcards.length === 0) {
        try {
-            let yamlTags = (await readFile(`${tagBasePath}/temp/wcet.txt`)).split("\n");
+            let umiTags = (await readFile(`${tagBasePath}/temp/umi_tags.txt`)).split("\n");
            // Split into tag, count pairs
-            yamlWildcards = yamlTags.map(x => x
+            umiWildcards = umiTags.map(x => x
                .trim()
                .split(","))
                .map(([i, ...rest]) => [
@@ -218,14 +223,14 @@ async function load() {
                    }, {}),
                ]);
        } catch (e) {
-            console.error("Error loading yaml wildcards: " + e);
+            console.error("Error loading umi wildcards: " + e);
        }
    }
 }

 function sanitize(tagType, text) {
-    // Replace underscores only if the yaml tag is not using them
-    if (tagType === ResultType.yamlWildcard && !yamlWildcards.includes(text)) {
+    // Replace underscores only if the umi tag is not using them
+    if (tagType === ResultType.umiWildcard && !umiWildcards.includes(text)) {
        return text.replaceAll("_", " "); 
    }
    return null;
--- a/javascript/ext_wildcards.js
+++ b/javascript/ext_wildcards.js
@@ -13,12 +13,40 @@ class WildcardParser extends BaseTagParser {
        let wcWord = wcMatch[0][2];

        // Look in normal wildcard files
-        let wcFound = wildcardFiles.find(x => x[1].toLowerCase() === wcFile);
+        let wcFound = wildcardFiles.filter(x => x[1].toLowerCase() === wcFile);
+        if (wcFound.length === 0) wcFound = null;
        // Use found wildcard file or look in external wildcard files
-        let wcPair = wcFound || wildcardExtFiles.find(x => x[1].toLowerCase() === wcFile);
+        let wcPairs = wcFound || wildcardExtFiles.filter(x => x[1].toLowerCase() === wcFile);

-        let wildcards = (await readFile(`${wcPair[0]}/${wcPair[1]}.txt`)).split("\n")
-            .filter(x => x.trim().length > 0 && !x.startsWith('#'));  // Remove empty lines and comments
+        if (!wcPairs) return [];
+
+        let wildcards = [];
+        for (let i = 0; i < wcPairs.length; i++) {
+            const basePath = wcPairs[i][0];
+            const fileName = wcPairs[i][1];
+            if (!basePath || !fileName) return;
+
+            // YAML wildcards are already loaded as json, so we can get the values directly.
+            // basePath is the name of the file in this case, and fileName the key
+            if (basePath.endsWith(".yaml")) {
+                const getDescendantProp = (obj, desc) => {
+                    const arr = desc.split("/");
+                    while (arr.length) {
+                      obj = obj[arr.shift()];
+                    }
+                    return obj;
+                }
+                wildcards = wildcards.concat(getDescendantProp(yamlWildcards[basePath], fileName));
+            } else {
+                const fileContent = (await fetchAPI(`tacapi/v1/wildcard-contents?basepath=${basePath}&filename=${fileName}.txt`, false))
+                    .split("\n")
+                    .filter(x => x.trim().length > 0 && !x.startsWith('#'));  // Remove empty lines and comments
+                wildcards = wildcards.concat(fileContent);
+            }
+        }
+
+        if (TAC_CFG.sortWildcardResults)
+            wildcards.sort((a, b) => a.localeCompare(b));

        let finalResults = [];
        let tempResults = wildcards.filter(x => (wcWord !== null && wcWord.length > 0) ? x.toLowerCase().includes(wcWord) : x) // Filter by tagword
@@ -44,13 +72,28 @@ class WildcardFileParser extends BaseTagParser {
        }

        let finalResults = [];
+        const alreadyAdded = new Map();
        // Get final results
        tempResults.forEach(wcFile => {
-            let result = new AutocompleteResult(wcFile[1].trim(), ResultType.wildcardFile);
-            result.meta = "Wildcard file";
+            // Skip duplicate entries incase multiple files have the same name or yaml category
+            if (alreadyAdded.has(wcFile[1])) return;
+
+            let result = null;
+            if (wcFile[0].endsWith(".yaml")) {
+                result = new AutocompleteResult(wcFile[1].trim(), ResultType.yamlWildcard);
+                result.meta = "YAML wildcard collection";
+            } else {
+                result = new AutocompleteResult(wcFile[1].trim(), ResultType.wildcardFile);
+                result.meta = "Wildcard file";
+                result.sortKey = wcFile[2].trim();
+            }
+
            finalResults.push(result);
+            alreadyAdded.set(wcFile[1], true);
        });

+        finalResults.sort(getSortFunction());
+
        return finalResults;
    }
 }
@@ -58,17 +101,19 @@ class WildcardFileParser extends BaseTagParser {
 async function load() {
    if (wildcardFiles.length === 0 && wildcardExtFiles.length === 0) {
        try {
-            let wcFileArr = (await readFile(`${tagBasePath}/temp/wc.txt`)).split("\n");
-            let wcBasePath = wcFileArr[0].trim(); // First line should be the base path
-            wildcardFiles = wcFileArr.slice(1)
-                .filter(x => x.trim().length > 0) // Remove empty lines
-                .map(x => [wcBasePath, x.trim().replace(".txt", "")]); // Remove file extension & newlines
+            let wcFileArr = await loadCSV(`${tagBasePath}/temp/wc.txt`);
+            if (wcFileArr && wcFileArr.length > 0) {
+                let wcBasePath = wcFileArr[0][0].trim(); // First line should be the base path
+                wildcardFiles = wcFileArr.slice(1)
+                    .filter(x => x[0]?.trim().length > 0) //Remove empty lines
+                    .map(x => [wcBasePath, x[0]?.trim().replace(".txt", ""), x[1]]); // Remove file extension & newlines
+            }

            // To support multiple sources, we need to separate them using the provided "-----" strings
-            let wcExtFileArr = (await readFile(`${tagBasePath}/temp/wce.txt`)).split("\n");
+            let wcExtFileArr = await loadCSV(`${tagBasePath}/temp/wce.txt`);
            let splitIndices = [];
            for (let index = 0; index < wcExtFileArr.length; index++) {
-                if (wcExtFileArr[index].trim() === "-----") {
+                if (wcExtFileArr[index][0].trim() === "-----") {
                    splitIndices.push(index);
                }
            }
@@ -79,14 +124,25 @@ async function load() {
                let end = splitIndices[i];

                let wcExtFile = wcExtFileArr.slice(start, end);
-                let base = wcExtFile[0].trim() + "/";
-                wcExtFile = wcExtFile.slice(1)
-                    .filter(x => x.trim().length > 0) // Remove empty lines
-                    .map(x => x.trim().replace(base, "").replace(".txt", "")); // Remove file extension & newlines;
-
-                wcExtFile = wcExtFile.map(x => [base, x]);
-                wildcardExtFiles.push(...wcExtFile);
+                if (wcExtFile && wcExtFile.length > 0) {
+                    let base = wcExtFile[0][0].trim() + "/";
+                    wcExtFile = wcExtFile.slice(1)
+                        .filter(x => x[0]?.trim().length > 0) //Remove empty lines
+                        .map(x => [base, x[0]?.trim().replace(base, "").replace(".txt", ""), x[1]]);
+                    wildcardExtFiles.push(...wcExtFile);
+                }
            }
+
+            // Load the yaml wildcard json file and append it as a wildcard file, appending each key as a path component until we reach the end
+            yamlWildcards = await readFile(`${tagBasePath}/temp/wc_yaml.json`, true);
+
+            // Append each key as a path component until we reach a leaf
+            Object.keys(yamlWildcards).forEach(file => {
+                const flattened = flatten(yamlWildcards[file], [], "/");
+                Object.keys(flattened).forEach(key => {
+                    wildcardExtFiles.push([file, key]);
+                });
+            });
        } catch (e) {
            console.error("Error loading wildcards: " + e);
        }
@@ -94,19 +150,18 @@ async function load() {
 }

 function sanitize(tagType, text) {
-    if (tagType === ResultType.wildcardFile) {
+    if (tagType === ResultType.wildcardFile || tagType === ResultType.yamlWildcard) {
        return `__${text}__`;
    } else if (tagType === ResultType.wildcardTag) {
-        return text.replace(/^.*?: /g, "");
+        return text;
    }
    return null;
 }

 function keepOpenIfWildcard(tagType, sanitizedText, newPrompt, textArea) {
    // If it's a wildcard, we want to keep the results open so the user can select another wildcard
-    if (tagType === ResultType.wildcardFile) {
+    if (tagType === ResultType.wildcardFile || tagType === ResultType.yamlWildcard) {
        hideBlocked = true;
-        autocomplete(textArea, newPrompt, sanitizedText);
        setTimeout(() => { hideBlocked = false; }, 450);
        return true;
    }
--- a/javascript/tagAutocomplete.js
+++ b/javascript/tagAutocomplete.js
@@ -1,4 +1,5 @@
 const styleColors = {
+    "--results-neutral-text": ["#e0e0e0","black"],
    "--results-bg": ["#0b0f19", "#ffffff"],
    "--results-border-color": ["#4b5563", "#e5e7eb"],
    "--results-border-width": ["1px", "1.5px"],
@@ -25,18 +26,37 @@ const autocompleteCSS = `
        background-color: transparent;
        min-width: fit-content;
    }
-    .autocompleteResults {
+    .autocompleteParent {
+        display: flex;
        position: absolute;
        z-index: 999;
        max-width: calc(100% - 1.5rem);
        margin: 5px 0 0 0;
+    }
+    .autocompleteResults {
        background-color: var(--results-bg) !important;
        border: var(--results-border-width) solid var(--results-border-color) !important;
+        color: var(--results-neutral-text) !important;
        border-radius: 12px !important;
+        height: fit-content;
+        flex-basis: fit-content;
+        flex-shrink: 0;
        overflow-y: var(--results-overflow-y);
        overflow-x: hidden;
        word-break: break-word;
    }
+    .sideInfo {
+        display: none;
+        position: relative;
+        margin-left: 10px;
+        height: 18rem;
+        max-width: 16rem;
+    }
+    .sideInfo > img {
+        object-fit: cover;
+        height: 100%;
+        width: 100%;
+    }
    .autocompleteResultsList > li:nth-child(odd) {
        background-color: var(--results-bg-odd);
    }
@@ -56,6 +76,7 @@ const autocompleteCSS = `
    }
    .acListItem {
        white-space: break-spaces;
+        min-width: 100px;
    }
    .acMetaText {
        position: relative;
@@ -65,6 +86,10 @@ const autocompleteCSS = `
        white-space: nowrap;
        color: var(--meta-text-color);
    }
+    .acMetaText.biased::before {
+        content: "✨";
+        margin-right: 2px;
+    }
    .acWikiLink {
        padding: 0.5rem;
        margin: -0.5rem 0 -0.5rem -0.5rem;
@@ -190,11 +215,23 @@ async function syncOptions() {
        resultStepLength: opts["tac_resultStepLength"],
        delayTime: opts["tac_delayTime"],
        useWildcards: opts["tac_useWildcards"],
+        sortWildcardResults: opts["tac_sortWildcardResults"],
        useEmbeddings: opts["tac_useEmbeddings"],
+        includeEmbeddingsInNormalResults: opts["tac_includeEmbeddingsInNormalResults"],
        useHypernetworks: opts["tac_useHypernetworks"],
        useLoras: opts["tac_useLoras"],
-	    useLycos: opts["tac_useLycos"],
+        useLycos: opts["tac_useLycos"],
+        useLoraPrefixForLycos: opts["tac_useLoraPrefixForLycos"],
        showWikiLinks: opts["tac_showWikiLinks"],
+        showExtraNetworkPreviews: opts["tac_showExtraNetworkPreviews"],
+        modelSortOrder: opts["tac_modelSortOrder"],
+        frequencySort: opts["tac_frequencySort"],
+        frequencyFunction: opts["tac_frequencyFunction"],
+        frequencyMinCount: opts["tac_frequencyMinCount"],
+        frequencyMaxAge: opts["tac_frequencyMaxAge"],
+        frequencyRecommendCap: opts["tac_frequencyRecommendCap"],
+        frequencyIncludeAlias: opts["tac_frequencyIncludeAlias"],
+        useStyleVars: opts["tac_useStyleVars"],
        // Insertion related settings
        replaceUnderscores: opts["tac_replaceUnderscores"],
        escapeParentheses: opts["tac_escapeParentheses"],
@@ -203,6 +240,7 @@ async function syncOptions() {
        alwaysSpaceAtEnd: opts["tac_alwaysSpaceAtEnd"],
        wildcardCompletionMode: opts["tac_wildcardCompletionMode"],
        modelKeywordCompletion: opts["tac_modelKeywordCompletion"],
+        modelKeywordLocation: opts["tac_modelKeywordLocation"],
        // Alias settings
        alias: {
            searchByAlias: opts["tac_alias.searchByAlias"],
@@ -246,6 +284,17 @@ async function syncOptions() {
        await loadTags(newCFG);
    }

+    // Refresh temp files if model sort order changed
+    // Contrary to the other loads, this one shouldn't happen on a first time load
+    if (TAC_CFG && newCFG.modelSortOrder !== TAC_CFG.modelSortOrder) {
+        const dropdown = gradioApp().querySelector("#setting_tac_modelSortOrder");
+        dropdown.style.opacity = 0.5;
+        dropdown.style.pointerEvents = "none";
+        await refreshTacTempFiles(true);
+        dropdown.style.opacity = null;
+        dropdown.style.pointerEvents = null;
+    }
+
    // Update CSS if maxResults changed
    if (TAC_CFG && newCFG.maxResults !== TAC_CFG.maxResults) {
        gradioApp().querySelectorAll(".autocompleteResults").forEach(r => {
@@ -269,50 +318,65 @@ async function syncOptions() {

 // Create the result list div and necessary styling
 function createResultsDiv(textArea) {
+    let parentDiv = document.createElement("div");
    let resultsDiv = document.createElement("div");
    let resultsList = document.createElement("ul");
+    let sideDiv = document.createElement("div");
+    let sideDivImg = document.createElement("img");

    let textAreaId = getTextAreaIdentifier(textArea);
    let typeClass = textAreaId.replaceAll(".", " ");

+    parentDiv.setAttribute("class", `autocompleteParent${typeClass}`);
+
    resultsDiv.style.maxHeight = `${TAC_CFG.maxResults * 50}px`;
-    resultsDiv.setAttribute("class", `autocompleteResults ${typeClass} notranslate`);
+    resultsDiv.setAttribute("class", `autocompleteResults${typeClass} notranslate`);
    resultsDiv.setAttribute("translate", "no");
    resultsList.setAttribute("class", "autocompleteResultsList");
    resultsDiv.appendChild(resultsList);

-    return resultsDiv;
+    sideDiv.setAttribute("class", `autocompleteResults${typeClass} sideInfo`);
+    sideDiv.appendChild(sideDivImg);
+
+    parentDiv.appendChild(resultsDiv);
+    parentDiv.appendChild(sideDiv);
+
+    return parentDiv;
 }

 // Show or hide the results div
 function isVisible(textArea) {
    let textAreaId = getTextAreaIdentifier(textArea);
-    let resultsDiv = gradioApp().querySelector('.autocompleteResults' + textAreaId);
-    return resultsDiv.style.display === "block";
+    let parentDiv = gradioApp().querySelector('.autocompleteParent' + textAreaId);
+    return parentDiv.style.display === "flex";
 }
 function showResults(textArea) {
    let textAreaId = getTextAreaIdentifier(textArea);
-    let resultsDiv = gradioApp().querySelector('.autocompleteResults' + textAreaId);
-    resultsDiv.style.display = "block";
+    let parentDiv = gradioApp().querySelector('.autocompleteParent' + textAreaId);
+    parentDiv.style.display = "flex";

    if (TAC_CFG.slidingPopup) {
        let caretPosition = getCaretCoordinates(textArea, textArea.selectionEnd).left;
-        let offset = Math.min(textArea.offsetLeft - textArea.scrollLeft + caretPosition, textArea.offsetWidth - resultsDiv.offsetWidth);
-    
-        resultsDiv.style.left = `${offset}px`;
+        let offset = Math.min(textArea.offsetLeft - textArea.scrollLeft + caretPosition, textArea.offsetWidth - parentDiv.offsetWidth);
+
+        parentDiv.style.left = `${offset}px`;
    } else {
-        if (resultsDiv.style.left)
-            resultsDiv.style.removeProperty("left");
+        if (parentDiv.style.left)
+            parentDiv.style.removeProperty("left");
    }
    // Reset here too to make absolutely sure the browser registers it
-    resultsDiv.scrollTop = 0;
+    parentDiv.scrollTop = 0;
+
+    // Ensure preview is hidden
+    let previewDiv = gradioApp().querySelector(`.autocompleteParent${textAreaId} .sideInfo`);
+    previewDiv.style.display = "none";
 }
 function hideResults(textArea) {
    let textAreaId = getTextAreaIdentifier(textArea);
-    let resultsDiv = gradioApp().querySelector('.autocompleteResults' + textAreaId);
-    
+    let resultsDiv = gradioApp().querySelector('.autocompleteParent' + textAreaId);
+
    if (!resultsDiv) return;
-    
+
    resultsDiv.style.display = "none";
    selectedTag = null;
 }
@@ -322,12 +386,12 @@ function isEnabled() {
    if (TAC_CFG.activeIn.global) {
        // Skip check if the current model was not correctly detected, since it could wrongly disable the script otherwise
        if (!currentModelName || !currentModelHash) return true;
-        
+
        let modelList = TAC_CFG.activeIn.modelList
            .split(",")
            .map(x => x.trim())
            .filter(x => x.length > 0);
-        
+
        let shortHash = currentModelHash.substring(0, 10);
        let modelNameWithoutHash = currentModelName.replace(/\[.*\]$/g, "").trim();
        if (TAC_CFG.activeIn.modelListMode.toLowerCase() === "blacklist") {
@@ -346,9 +410,10 @@ function isEnabled() {
 const WEIGHT_REGEX = /[([]([^()[\]:|]+)(?::(?:\d+(?:\.\d+)?|\.\d+))?[)\]]/g;
 const POINTY_REGEX = /<[^\s,<](?:[^\t\n\r,<>]*>|[^\t\n\r,> ]*)/g;
 const COMPLETED_WILDCARD_REGEX = /__[^\s,_][^\t\n\r,_]*[^\s,_]__[^\s,_]*/g;
-const NORMAL_TAG_REGEX = /[^\s,|<>)\]]+|</g;
+const STYLE_VAR_REGEX = /\$\(?[^$|\[\],\s]*\)?/g;
+const NORMAL_TAG_REGEX = /[^\s,|<>\[\]:]+_\([^\s,|<>\[\]:]*\)?|[^\s,|<>():\[\]]+|</g;
 const RUBY_TAG_REGEX = /[\w\d<][\w\d' \-?!/$%]{2,}>?/g;
-const TAG_REGEX = new RegExp(`${POINTY_REGEX.source}|${COMPLETED_WILDCARD_REGEX.source}|${NORMAL_TAG_REGEX.source}`, "g");
+const TAG_REGEX = new RegExp(`${POINTY_REGEX.source}|${COMPLETED_WILDCARD_REGEX.source}|${STYLE_VAR_REGEX.source}|${NORMAL_TAG_REGEX.source}`, "g");

 // On click, insert the tag into the prompt textbox with respect to the cursor position
 async function insertTextAtCursor(textArea, result, tagword, tabCompletedWithoutChoice = false) {
@@ -375,7 +440,7 @@ async function insertTextAtCursor(textArea, result, tagword, tabCompletedWithout
        }
    }

-    if (tagType === ResultType.wildcardFile
+    if ((tagType === ResultType.wildcardFile || tagType === ResultType.yamlWildcard)
        && tabCompletedWithoutChoice
        && TAC_CFG.wildcardCompletionMode !== "Always fully"
        && sanitizedText.includes("/")) {
@@ -402,13 +467,46 @@ async function insertTextAtCursor(textArea, result, tagword, tabCompletedWithout
                }
            }
            // Don't cut off the __ at the end if it is already the full path
-            if (firstDifference < longestResult) {
+            if (firstDifference > 0 && firstDifference < longestResult) {
                // +2 because the sanitized text already has the __ at the start but the matched text doesn't
                sanitizedText = sanitizedText.substring(0, firstDifference + 2);
+            } else if (firstDifference === 0) {
+                sanitizedText = tagword;
            }
        }
    }

+    // Frequency db update
+    if (TAC_CFG.frequencySort) {
+        let name = null;
+
+        switch (tagType) {
+            case ResultType.wildcardFile:
+            case ResultType.yamlWildcard:
+                // We only want to update the frequency for a full wildcard, not partial paths
+                if (sanitizedText.endsWith("__"))
+                    name = text
+                break;
+            case ResultType.chant:
+                // Chants use a slightly different format
+                name = result.aliases;
+                break;
+            default:
+                name = text;
+                break;
+        }
+
+        if (name && name.length > 0) {
+            // Check if it's a negative prompt
+            let textAreaId = getTextAreaIdentifier(textArea);
+            let isNegative = textAreaId.includes("n");
+            // Sanitize name for API call
+            name = encodeURIComponent(name)
+            // Call API & update db
+            increaseUseCount(name, tagType, isNegative)
+        }
+    }
+
    var prompt = textArea.value;

    // Edit prompt text
@@ -420,7 +518,7 @@ async function insertTextAtCursor(textArea, result, tagword, tabCompletedWithout

    var optionalSeparator = "";
    let extraNetworkTypes = [ResultType.hypernetwork, ResultType.lora];
-    let noCommaTypes = [ResultType.wildcardFile, ResultType.yamlWildcard].concat(extraNetworkTypes);
+    let noCommaTypes = [ResultType.wildcardFile, ResultType.yamlWildcard, ResultType.umiWildcard].concat(extraNetworkTypes);
    if (!noCommaTypes.includes(tagType)) {
        // Append comma if enabled and not already present
        let beforeComma = surrounding.match(new RegExp(`${escapeRegExp(tagword)}[,:]`, "i")) !== null;
@@ -437,6 +535,10 @@ async function insertTextAtCursor(textArea, result, tagword, tabCompletedWithout
        optionalSeparator = TAC_CFG.extraNetworksSeparator || " ";
    }

+    // Escape $ signs since they are special chars for the replace function
+    // We need four since we're also escaping them in replaceAll in the first place
+    sanitizedText = sanitizedText.replaceAll("$", "$$$$");
+
    // Replace partial tag word with new text, add comma if needed
    let insert = surrounding.replace(match, sanitizedText + optionalSeparator);

@@ -455,11 +557,19 @@ async function insertTextAtCursor(textArea, result, tagword, tabCompletedWithout
                keywords = info["activation text"];
            }
        }
-        
+
        if (!keywords && modelKeywordPath.length > 0 && result.hash && result.hash !== "NOFILE" && result.hash.length > 0) {
            let nameDict = modelKeywordDict.get(result.hash);
            let names = [result.text + ".safetensors", result.text + ".pt", result.text + ".ckpt"];

+            // No match, try to find a sha256 match from the cache file
+            if (!nameDict) {
+                const sha256 = await fetchAPI(`/tacapi/v1/lora-cached-hash/${result.text}`)
+                if (sha256) {
+                    nameDict = modelKeywordDict.get(sha256);
+                }
+            }
+
            if (nameDict) {
                let found = false;
                names.forEach(name => {
@@ -468,7 +578,7 @@ async function insertTextAtCursor(textArea, result, tagword, tabCompletedWithout
                        keywords = nameDict.get(name);
                    }
                });
-                
+
                if (!found)
                    keywords = nameDict.get("none");
            }
@@ -476,24 +586,37 @@ async function insertTextAtCursor(textArea, result, tagword, tabCompletedWithout

        if (keywords && keywords.length > 0) {
            textBeforeKeywordInsertion = newPrompt;
-            
-            newPrompt = `${keywords}, ${newPrompt}`; // Insert keywords
-            
+
+            if (TAC_CFG.modelKeywordLocation === "Start of prompt")
+                newPrompt = `${keywords}, ${newPrompt}`; // Insert keywords
+            else if (TAC_CFG.modelKeywordLocation === "End of prompt")
+                newPrompt = `${newPrompt}, ${keywords}`; // Insert keywords
+            else {
+                let keywordStart = prompt[editStart - 1] === " " ? editStart - 1 : editStart;
+                newPrompt = prompt.substring(0, keywordStart) + `, ${keywords} ${insert}` + prompt.substring(editEnd);
+            }
+
+
            textAfterKeywordInsertion = newPrompt;
            keywordInsertionUndone = false;
            setTimeout(() => lastEditWasKeywordInsertion = true, 200)
-            
+
            keywordsLength = keywords.length + 2; // +2 for the comma and space
        }
    }
-    
+
    // Insert into prompt textbox and reposition cursor
    textArea.value = newPrompt;
    textArea.selectionStart = afterInsertCursorPos + optionalSeparator.length + keywordsLength;
    textArea.selectionEnd = textArea.selectionStart

+    // Set self trigger flag to show wildcard contents after the filename was inserted
+    if ([ResultType.wildcardFile, ResultType.yamlWildcard, ResultType.umiWildcard].includes(result.type))
+        tacSelfTrigger = true;
    // Since we've modified a Gradio Textbox component manually, we need to simulate an `input` DOM event to ensure it's propagated back to python.
    // Uses a built-in method from the webui's ui.js which also already accounts for event target
+    if (tagType === ResultType.wildcardTag || tagType === ResultType.wildcardFile || tagType === ResultType.yamlWildcard)
+        tacSelfTrigger = true;
    updateInput(textArea);

    // Update previous tags with the edited prompt to prevent re-searching the same term
@@ -581,11 +704,6 @@ function addResultsToList(textArea, results, tagword, resetList) {

            if (!TAC_CFG.alias.onlyShowAlias && result.text !== bestAlias)
                displayText += " ➝ " + result.text;
-        } else if (result.type === ResultType.lora || result.type === ResultType.lyco) {
-            let lastDot = result.text.lastIndexOf(".");
-            let lastSlash = result.text.lastIndexOf("/");
-            let name = result.text.substring(lastSlash + 1, lastDot);
-            displayText = escapeHTML(name);
        } else { // No alias
            displayText = escapeHTML(result.text);
        }
@@ -597,7 +715,8 @@ function addResultsToList(textArea, results, tagword, resetList) {
        // Print search term bolded in result
        itemText.innerHTML = displayText.replace(tagword, `<b>${tagword}</b>`);

-        if (result.type === ResultType.wildcardFile && itemText.innerHTML.includes("/")) {
+        const splitTypes = [ResultType.wildcardFile, ResultType.yamlWildcard]
+        if (splitTypes.includes(result.type) && itemText.innerHTML.includes("/")) {
            let parts = itemText.innerHTML.split("/");
            let lastPart = parts[parts.length - 1];
            parts = parts.slice(0, parts.length - 1);
@@ -612,12 +731,20 @@ function addResultsToList(textArea, results, tagword, resetList) {
            let wikiLink = document.createElement("a");
            wikiLink.classList.add("acWikiLink");
            wikiLink.innerText = "?";
+            wikiLink.title = "Open external wiki page for this tag"

            let linkPart = displayText;
            // Only use alias result if it is one
            if (displayText.includes("➝"))
                linkPart = displayText.split(" ➝ ")[1];
-            
+
+            // Remove any trailing translations
+            if (linkPart.includes("[")) {
+                linkPart = linkPart.split("[")[0]
+            }
+
+            linkPart = encodeURIComponent(linkPart);
+
            // Set link based on selected file
            let tagFileNameLower = tagFileName.toLowerCase();
            if (tagFileNameLower.startsWith("danbooru")) {
@@ -625,7 +752,7 @@ function addResultsToList(textArea, results, tagword, resetList) {
            } else if (tagFileNameLower.startsWith("e621")) {
                wikiLink.href = `https://e621.net/wiki_pages/${linkPart}`;
            }
-            
+
            wikiLink.target = "_blank";
            flexDiv.appendChild(wikiLink);
        }
@@ -650,7 +777,7 @@ function addResultsToList(textArea, results, tagword, resetList) {
        }

        // Post count
-        if (result.count && !isNaN(result.count)) {
+        if (result.count && !isNaN(result.count) && result.count !== Number.MAX_SAFE_INTEGER) {
            let postCount = result.count;
            let formatter;

@@ -678,12 +805,28 @@ function addResultsToList(textArea, results, tagword, resetList) {
                else if (result.meta.startsWith("v2"))
                    itemText.classList.add("acEmbeddingV2");
            }
-                
+
            flexDiv.appendChild(metaDiv);
        }

+        // Add small ✨ marker to indicate usage sorting
+        if (result.usageBias) {
+            flexDiv.querySelector(".acMetaText").classList.add("biased");
+            flexDiv.title = "✨ Frequent tag. Ctrl/Cmd + click to reset usage count."
+        }
+
+        // Check if it's a negative prompt
+        let isNegative = textAreaId.includes("n");
+
        // Add listener
-        li.addEventListener("click", function () { insertTextAtCursor(textArea, result, tagword); });
+        li.addEventListener("click", (e) => {
+            if (e.ctrlKey || e.metaKey) {
+                resetUseCount(result.text, result.type, !isNegative, isNegative);
+                flexDiv.querySelector(".acMetaText").classList.remove("biased");
+            } else {
+                insertTextAtCursor(textArea, result, tagword);
+            }
+        });
        // Add element to list
        resultsList.appendChild(li);
    }
@@ -696,7 +839,7 @@ function addResultsToList(textArea, results, tagword, resetList) {
    }
 }

-function updateSelectionStyle(textArea, newIndex, oldIndex) {
+async function updateSelectionStyle(textArea, newIndex, oldIndex) {
    let textAreaId = getTextAreaIdentifier(textArea);
    let resultDiv = gradioApp().querySelector('.autocompleteResults' + textAreaId);
    let resultsList = resultDiv.querySelector('ul');
@@ -708,13 +851,52 @@ function updateSelectionStyle(textArea, newIndex, oldIndex) {

    // make it safer
    if (newIndex !== null) {
-        items[newIndex].classList.add('selected');
+        let selected = items[newIndex];
+        selected.classList.add('selected');
+
+         // Set scrolltop to selected item
+        resultDiv.scrollTop = selected.offsetTop - resultDiv.offsetTop;
    }

-    // Set scrolltop to selected item if we are showing more than max results
-    if (items.length > TAC_CFG.maxResults) {
+    // Show preview if enabled and the selected type supports it
+    if (newIndex !== null) {
        let selected = items[newIndex];
-        resultDiv.scrollTop = selected.offsetTop - resultDiv.offsetTop;
+        let previewTypes = ["v1 Embedding", "v2 Embedding", "Hypernetwork", "Lora", "Lyco"];
+        let selectedType = selected.querySelector(".acMetaText").innerText;
+        let selectedFilename = selected.querySelector(".acListItem").innerText;
+
+        let previewDiv = gradioApp().querySelector(`.autocompleteParent${textAreaId} .sideInfo`);
+
+        if (TAC_CFG.showExtraNetworkPreviews && previewTypes.includes(selectedType)) {
+            let shorthandType = "";
+            switch (selectedType) {
+                case "v1 Embedding":
+                case "v2 Embedding":
+                    shorthandType = "embed";
+                    break;
+                case "Hypernetwork":
+                    shorthandType = "hyper";
+                    break;
+                case "Lora":
+                    shorthandType = "lora";
+                    break;
+                case "Lyco":
+                    shorthandType = "lyco";
+                    break;
+            }
+
+            let img = previewDiv.querySelector("img");
+
+            let url = await getExtraNetworkPreviewURL(selectedFilename, shorthandType);
+            if (url) {
+                img.src = url;
+                previewDiv.style.display = "block";
+            } else {
+                previewDiv.style.display = "none";
+            }
+        } else {
+            previewDiv.style.display = "none";
+        }
    }
 }

@@ -730,7 +912,7 @@ function updateRuby(textArea, prompt) {
        ruby.setAttribute("class", `acRuby${typeClass} notranslate`);
        textArea.parentNode.appendChild(ruby);
    }
-    
+
    ruby.innerText = prompt;

    let bracketEscapedPrompt = prompt.replaceAll("\\(", "$").replaceAll("\\)", "%");
@@ -748,9 +930,9 @@ function updateRuby(textArea, prompt) {
            .replaceAll(" ", "_")
            .replaceAll("\\(", "(")
            .replaceAll("\\)", ")");
-        
+
        const translation = translations?.get(tag) || translations?.get(unsanitizedTag); 
-        
+
        let escapedTag = escapeRegExp(tag);
        return { tag, escapedTag, translation };
    }
@@ -766,14 +948,14 @@ function updateRuby(textArea, prompt) {
    // First try to find direct matches
    [...rubyTags].forEach(tag => {
        let tuple = prepareTag(tag);
-        
+
        if (tuple.translation) {
            html = replaceOccurences(html, tuple);
        } else {
            let subTags = tuple.tag.split(" ").filter(x => x.trim().length > 0);
            // Return if there is only one word
            if (subTags.length === 1) return;
-            
+
            let subHtml = tag.replaceAll("$", "\\(").replaceAll("%", "\\)");

            let translateNgram = (windows) => {
@@ -788,14 +970,14 @@ function updateRuby(textArea, prompt) {
                    }
                });
            }
-    
+
            // Perform n-gram sliding window search
            translateNgram(toNgrams(subTags, 3));
            translateNgram(toNgrams(subTags, 2));
            translateNgram(toNgrams(subTags, 1));

            let escapedTag = escapeRegExp(tuple.tag);
-            
+
            let searchRegex = new RegExp(`(?<!<ruby>)(?:\\b)${escapedTag}(?:\\b|$|(?=[,|: \\t\\n\\r]))(?!<rt>)`, "g");
            html = html.replaceAll(searchRegex, subHtml);
        }
@@ -832,6 +1014,7 @@ function checkKeywordInsertionUndo(textArea, event) {
            if (lastEditWasKeywordInsertion && !keywordInsertionUndone) {
                keywordInsertionUndone = true;
                textArea.value = textBeforeKeywordInsertion;
+                tacSelfTrigger = true;
                updateInput(textArea);
            }
            break;
@@ -839,6 +1022,7 @@ function checkKeywordInsertionUndo(textArea, event) {
            if (lastEditWasKeywordInsertion && keywordInsertionUndone) {
                keywordInsertionUndone = false;
                textArea.value = textAfterKeywordInsertion;
+                tacSelfTrigger = true;
                updateInput(textArea);
            }
        case undefined:
@@ -873,7 +1057,7 @@ async function autocomplete(textArea, prompt, fixedTag = null) {
            .map(match => match[1]);
        let tags = prompt.match(TAG_REGEX)
        if (weightedTags !== null && tags !== null) {
-            tags = tags.filter(tag => !weightedTags.some(weighted => tag.includes(weighted) && !tag.startsWith("<[")))
+            tags = tags.filter(tag => !weightedTags.some(weighted => tag.includes(weighted) && !tag.startsWith("<[") && !tag.startsWith("$(")))
                .concat(weightedTags);
        }

@@ -907,46 +1091,29 @@ async function autocomplete(textArea, prompt, fixedTag = null) {
    }

    results = [];
+    resultCountBeforeNormalTags = 0;
    tagword = tagword.toLowerCase().replace(/[\n\r]/g, "");

+    // Needed for slicing check later
+    let normalTags = false;
+
    // Process all parsers
-    let resultCandidates = await processParsers(textArea, prompt);
+    let resultCandidates = (await processParsers(textArea, prompt))?.filter(x => x.length > 0);
    // If one ore more result candidates match, use their results
    if (resultCandidates && resultCandidates.length > 0) {
        // Flatten our candidate(s)
        results = resultCandidates.flat();
-        // If there was more than one candidate, sort the results by text to mix them
-        // instead of having them added in the order of the parsers
-        let shouldSort = resultCandidates.length > 1;
-        if (shouldSort) {
-            results = results.sort((a, b) => {
-                let sortByA = a.type === ResultType.chant ? a.aliases : a.text;
-                let sortByB = b.type === ResultType.chant ? b.aliases : b.text;
-                return sortByA.localeCompare(sortByB);
-            });
+        // Sort results, but not if it's umi tags since they are sorted by count
+        if (!(resultCandidates.length === 1 && results[0].type === ResultType.umiWildcard))
+            results = results.sort(getSortFunction());
+    }
+    // Else search the normal tag list
+    if (!resultCandidates || resultCandidates.length === 0
+        || (TAC_CFG.includeEmbeddingsInNormalResults && !(tagword.startsWith("<") || tagword.startsWith("*<")))
+    ) {
+        normalTags = true;
+        resultCountBeforeNormalTags = results.length;

-            // Since some tags are kaomoji, we have to add the normal results in some cases
-            if (tagword.startsWith("<") || tagword.startsWith("*<")) {
-                // Create escaped search regex with support for * as a start placeholder
-                let searchRegex;
-                if (tagword.startsWith("*")) {
-                    tagword = tagword.slice(1);
-                    searchRegex = new RegExp(`${escapeRegExp(tagword)}`, 'i');
-                } else {
-                    searchRegex = new RegExp(`(^|[^a-zA-Z])${escapeRegExp(tagword)}`, 'i');
-                }
-                let genericResults = allTags.filter(x => x[0].toLowerCase().search(searchRegex) > -1).slice(0, TAC_CFG.maxResults);
-
-                genericResults.forEach(g => {
-                    let result = new AutocompleteResult(g[0].trim(), ResultType.tag)
-                    result.category = g[1];
-                    result.count = g[2];
-                    result.aliases = g[3];
-                    results.push(result);
-                });
-            }
-        }
-    } else { // Else search the normal tag list
        // Create escaped search regex with support for * as a start placeholder
        let searchRegex;
        if (tagword.startsWith("*")) {
@@ -961,7 +1128,7 @@ async function autocomplete(textArea, prompt, fixedTag = null) {
        let aliasFilter = (x) => x[3] && x[3].toLowerCase().search(searchRegex) > -1;
        let translationFilter = (x) => (translations.has(x[0]) && translations.get(x[0]).toLowerCase().search(searchRegex) > -1)
            || x[3] && x[3].split(",").some(y => translations.has(y) && translations.get(y).toLowerCase().search(searchRegex) > -1);
-        
+
        let fil;
        if (TAC_CFG.alias.searchByAlias && TAC_CFG.translation.searchByTranslation)
            fil = (x) => baseFilter(x) || aliasFilter(x) || translationFilter(x);
@@ -999,11 +1166,6 @@ async function autocomplete(textArea, prompt, fixedTag = null) {
                results = results.concat(extraResults);
            }
        }
-        
-        // Slice if the user has set a max result count
-        if (!TAC_CFG.showAllResults) {
-            results = results.slice(0, TAC_CFG.maxResults);
-        }
    }

    // Guard for empty results
@@ -1013,6 +1175,57 @@ async function autocomplete(textArea, prompt, fixedTag = null) {
        return;
    }

+    // Sort again with frequency / usage count if enabled
+    if (TAC_CFG.frequencySort) {
+        // Split our results into a list of names and types
+        let tagNames = [];
+        let aliasNames = [];
+        let types = [];
+        // Limit to 2k for performance reasons
+        const aliasTypes = [ResultType.tag, ResultType.extra];
+        results.slice(0,2000).forEach(r => {
+            const name = r.type === ResultType.chant ? r.aliases : r.text;
+            // Add to alias list or tag list depending on if the name includes the tagword
+            // (the same criteria is used in the filter in calculateUsageBias)
+            if (aliasTypes.includes(r.type) && !name.includes(tagword)) {
+                aliasNames.push(name);
+            } else {
+                tagNames.push(name);
+            }
+            types.push(r.type);
+        });
+
+        // Check if it's a negative prompt
+        let textAreaId = getTextAreaIdentifier(textArea);
+        let isNegative = textAreaId.includes("n");
+
+        // Request use counts from the DB
+        const names = TAC_CFG.frequencyIncludeAlias ? tagNames.concat(aliasNames) : tagNames;
+        const counts = await getUseCounts(names, types, isNegative);
+
+        // Pre-calculate weights to prevent duplicate work
+        const resultBiasMap = new Map();
+        results.forEach(result => {
+            const name = result.type === ResultType.chant ? result.aliases : result.text;
+            const type = result.type;
+            // Find matching pair from DB results
+            const useStats = counts.find(c => c.name === name && c.type === type);
+            const uses = useStats?.count || 0;
+            // Calculate & set weight
+            const weight = calculateUsageBias(result, result.count, uses)
+            resultBiasMap.set(result, weight);
+        });
+        // Actual sorting with the pre-calculated weights
+        results = results.sort((a, b) => {
+            return resultBiasMap.get(b) - resultBiasMap.get(a);
+        });
+    }
+
+    // Slice if the user has set a max result count and we are not in a extra networks / wildcard list
+    if (!TAC_CFG.showAllResults && normalTags) {
+        results = results.slice(0, TAC_CFG.maxResults + resultCountBeforeNormalTags);
+    }
+
    addResultsToList(textArea, results, tagword, true);
    showResults(textArea);
 }
@@ -1020,7 +1233,7 @@ async function autocomplete(textArea, prompt, fixedTag = null) {
 function navigateInList(textArea, event) {
    // Return if the function is deactivated in the UI or the current model is excluded due to white/blacklist settings
    if (!isEnabled()) return;
-    
+
    let keys = TAC_CFG.keymap;

    // Close window if Home or End is pressed while not a keybinding, since it would break completion on leaving the original tag
@@ -1035,12 +1248,17 @@ function navigateInList(textArea, event) {

    if (!validKeys.includes(event.key)) return;
    if (!isVisible(textArea)) return
-    // Return if ctrl key is pressed to not interfere with weight editing shortcut
-    if (event.ctrlKey || event.altKey) return;
+    // Add modifier keys to base as text+.
+    let modKey = "";
+    if (event.ctrlKey) modKey += "Ctrl+";
+    if (event.altKey) modKey += "Alt+";
+    if (event.shiftKey) modKey += "Shift+";
+    if (event.metaKey) modKey += "Meta+";
+        modKey += event.key;

    oldSelectedTag = selectedTag;

-    switch (event.key) {
+    switch (modKey) {
        case keys["MoveUp"]:
            if (selectedTag === null) {
                selectedTag = resultCount - 1;
@@ -1070,10 +1288,25 @@ function navigateInList(textArea, event) {
            }
            break;
        case keys["JumpToStart"]:
-            selectedTag = 0;
+            if (TAC_CFG.includeEmbeddingsInNormalResults &&
+                selectedTag > resultCountBeforeNormalTags &&
+                resultCountBeforeNormalTags > 0
+            ) {
+                selectedTag = resultCountBeforeNormalTags;
+            } else {
+                selectedTag = 0;
+            }
            break;
        case keys["JumpToEnd"]:
-            selectedTag = resultCount - 1;
+            // Jump to the end of the list, or the end of embeddings if they are included in the normal results
+            if (TAC_CFG.includeEmbeddingsInNormalResults &&
+                selectedTag < resultCountBeforeNormalTags &&
+                resultCountBeforeNormalTags > 0
+            ) {
+                selectedTag = Math.min(resultCountBeforeNormalTags, resultCount - 1);
+            } else {
+                selectedTag = resultCount - 1;
+            }
            break;
        case keys["ChooseSelected"]:
            if (selectedTag !== null) {
@@ -1096,6 +1329,8 @@ function navigateInList(textArea, event) {
        case keys["Close"]:
            hideResults(textArea);
            break;
+        default:
+            if (event.ctrlKey || event.altKey || event.shiftKey || event.metaKey) return;
    }
    let moveKeys = [keys["MoveUp"], keys["MoveDown"], keys["JumpUp"], keys["JumpDown"], keys["JumpToStart"], keys["JumpToEnd"]];
    if (selectedTag === resultCount - 1 && moveKeys.includes(event.key)) {
@@ -1110,11 +1345,11 @@ function navigateInList(textArea, event) {
    event.stopPropagation();
 }

-async function refreshTacTempFiles() {
-    setTimeout(async () => {
+async function refreshTacTempFiles(api = false) {
+    const reload = async () => {
        wildcardFiles = [];
        wildcardExtFiles = [];
-        yamlWildcards = [];
+        umiWildcards = [];
        embeddings = [];
        hypernetworks = [];
        loras = [];
@@ -1123,7 +1358,23 @@ async function refreshTacTempFiles() {
        await processQueue(QUEUE_FILE_LOAD, null);

        console.log("TAC: Refreshed temp files");
-    }, 2000);
+    }
+    
+    if (api) {
+        await postAPI("tacapi/v1/refresh-temp-files");
+        await reload();
+    } else {
+        setTimeout(async () => {
+            await reload();
+        }, 2000);
+    }
+}
+
+async function refreshEmbeddings() {
+    await postAPI("tacapi/v1/refresh-embeddings", null);
+    embeddings = [];
+    await processQueue(QUEUE_FILE_LOAD, null);
+    console.log("TAC: Refreshed embeddings");
 }

 function addAutocompleteToArea(area) {
@@ -1146,8 +1397,13 @@ function addAutocompleteToArea(area) {

        // Add autocomplete event listener
        area.addEventListener('input', (e) => {
-            debounce(autocomplete(area, area.value), TAC_CFG.delayTime);
            updateRuby(area, area.value);
+
+            // Cancel autocomplete itself if the event has no inputType (e.g. because it was triggered by the updateInput() function)
+            if (!e.inputType && !tacSelfTrigger) return;
+            tacSelfTrigger = false;
+
+            debounce(autocomplete(area, area.value), TAC_CFG.delayTime);
            checkKeywordInsertionUndo(area, e);
        });
        // Add focusout event listener
@@ -1208,6 +1464,13 @@ async function setup() {
    // Listener for internal temp files refresh button
    gradioApp().querySelector("#refresh_tac_refreshTempFiles")?.addEventListener("click", refreshTacTempFiles);

+    // Also add listener for external network refresh button (plus triggering python code)
+    ["#img2img_extra_refresh", "#txt2img_extra_refresh"].forEach(e => {
+        gradioApp().querySelector(e)?.addEventListener("click", ()=>{
+            refreshTacTempFiles(true);
+        });
+    })
+
    // Add mutation observer for the model hash text to also allow hash-based blacklist again
    let modelHashText = gradioApp().querySelector("#sd_checkpoint_hash");
    updateModelName();
@@ -1218,6 +1481,7 @@ async function setup() {
                if (mutation.type === "attributes" && mutation.attributeName === "title") {
                    currentModelHash = mutation.target.title;
                    updateModelName();
+                    refreshEmbeddings();
                }
            }
        });
@@ -1227,8 +1491,8 @@ async function setup() {
    // Not found, we're on a page without prompt textareas
    if (textAreas.every(v => v === null || v === undefined)) return;
    // Already added or unnecessary to add
-    if (gradioApp().querySelector('.autocompleteResults.p')) {
-        if (gradioApp().querySelector('.autocompleteResults.n') || !TAC_CFG.activeIn.negativePrompts) {
+    if (gradioApp().querySelector('.autocompleteParent.p')) {
+        if (gradioApp().querySelector('.autocompleteParent.n') || !TAC_CFG.activeIn.negativePrompts) {
            return;
        }
    } else if (!TAC_CFG.activeIn.txt2img && !TAC_CFG.activeIn.img2img) {
@@ -1242,7 +1506,7 @@ async function setup() {
    let mode = (document.querySelector(".dark") || gradioApp().querySelector(".dark")) ? 0 : 1;
    // Check if we are on webkit
    let browser = navigator.userAgent.toLowerCase().indexOf('firefox') > -1 ? "firefox" : "other";
-    
+
    let css = autocompleteCSS;
    // Replace vars with actual values (can't use actual css vars because of the way we inject the css)
    Object.keys(styleColors).forEach((key) => {
@@ -1251,7 +1515,7 @@ async function setup() {
    Object.keys(browserVars).forEach((key) => {
        css = css.replaceAll(`var(${key})`, browserVars[key][browser]);
    })
-    
+
    if (acStyle.styleSheet) {
        acStyle.styleSheet.cssText = css;
    } else {
--- a/scripts/model_keyword_support.py
+++ b/scripts/model_keyword_support.py
@@ -16,6 +16,8 @@ hash_dict = {}


 def load_hash_cache():
+    if not known_hashes_file.exists():
+        known_hashes_file.touch()
    with open(known_hashes_file, "r", encoding="utf-8") as file:
        reader = csv.reader(
            file.readlines(), delimiter=",", quotechar='"', skipinitialspace=True
@@ -28,9 +30,12 @@ def load_hash_cache():
 def update_hash_cache():
    global file_needs_update
    if file_needs_update:
-        with open(known_hashes_file, "w", encoding="utf-8") as file:
+        if not known_hashes_file.exists():
+            known_hashes_file.touch()
+        with open(known_hashes_file, "w", encoding="utf-8", newline='') as file:
+            writer = csv.writer(file)
            for name, (hash, mtime) in hash_dict.items():
-                file.write(f'"{name}",{hash},{mtime}\n')
+                writer.writerow([name, hash, mtime])


 # Copy of the fast inaccurate hash function from the extension
--- a/scripts/shared_paths.py
+++ b/scripts/shared_paths.py
@@ -1,35 +1,39 @@
 from pathlib import Path
+
 from modules import scripts, shared

 try:
    from modules.paths import extensions_dir, script_path

    # Webui root path
-    FILE_DIR = Path(script_path)
+    FILE_DIR = Path(script_path).absolute()

    # The extension base path
-    EXT_PATH = Path(extensions_dir)
+    EXT_PATH = Path(extensions_dir).absolute()
 except ImportError:
    # Webui root path
    FILE_DIR = Path().absolute()
    # The extension base path
-    EXT_PATH = FILE_DIR.joinpath("extensions")
+    EXT_PATH = FILE_DIR.joinpath("extensions").absolute()

 # Tags base path
-TAGS_PATH = Path(scripts.basedir()).joinpath("tags")
+TAGS_PATH = Path(scripts.basedir()).joinpath("tags").absolute()

 # The path to the folder containing the wildcards and embeddings
-WILDCARD_PATH = FILE_DIR.joinpath("scripts/wildcards")
-EMB_PATH = Path(shared.cmd_opts.embeddings_dir)
-HYP_PATH = Path(shared.cmd_opts.hypernetwork_dir)
+WILDCARD_PATH = FILE_DIR.joinpath("scripts/wildcards").absolute()
+EMB_PATH = Path(shared.cmd_opts.embeddings_dir).absolute()
+HYP_PATH = Path(shared.cmd_opts.hypernetwork_dir).absolute()

 try:
-    LORA_PATH = Path(shared.cmd_opts.lora_dir)
+    LORA_PATH = Path(shared.cmd_opts.lora_dir).absolute()
 except AttributeError:
    LORA_PATH = None

 try:
-    LYCO_PATH = Path(shared.cmd_opts.lyco_dir)
+    try:
+        LYCO_PATH = Path(shared.cmd_opts.lyco_dir_backcompat).absolute()
+    except:
+        LYCO_PATH = Path(shared.cmd_opts.lyco_dir).absolute() # attempt original non-backcompat path
 except AttributeError:
    LYCO_PATH = None

@@ -37,6 +41,21 @@ except AttributeError:
 def find_ext_wildcard_paths():
    """Returns the path to the extension wildcards folder"""
    found = list(EXT_PATH.glob("*/wildcards/"))
+    # Try to find the wildcard path from the shared opts
+    try:
+        from modules.shared import opts
+    except ImportError:  # likely not in an a1111 context
+        opts = None
+
+    # Append custom wildcard paths
+    custom_paths = [
+        getattr(shared.cmd_opts, "wildcards_dir", None),    # Cmd arg from the wildcard extension
+        getattr(opts, "wildcard_dir", None),                # Custom path from sd-dynamic-prompts
+    ]
+    for path in [Path(p).absolute() for p in custom_paths if p is not None]:
+        if path.exists():
+            found.append(path)
+
    return found


@@ -45,8 +64,8 @@ WILDCARD_EXT_PATHS = find_ext_wildcard_paths()

 # The path to the temporary files
 # In the webui root, on windows it exists by default, on linux it doesn't
-STATIC_TEMP_PATH = FILE_DIR.joinpath("tmp")
-TEMP_PATH = TAGS_PATH.joinpath("temp")  # Extension specific temp files
+STATIC_TEMP_PATH = FILE_DIR.joinpath("tmp").absolute()
+TEMP_PATH = TAGS_PATH.joinpath("temp").absolute()  # Extension specific temp files

 # Make sure these folders exist
 if not TEMP_PATH.exists():
--- a/scripts/tag_autocomplete_helper.py
+++ b/scripts/tag_autocomplete_helper.py
@@ -2,71 +2,170 @@
 # to a temporary file to expose it to the javascript side

 import glob
+import importlib
 import json
+import sqlite3
+import urllib.parse
 from pathlib import Path

 import gradio as gr
 import yaml
 from fastapi import FastAPI
-from fastapi.responses import FileResponse
-from modules import script_callbacks, sd_hijack, shared
+from fastapi.responses import Response, FileResponse, JSONResponse
+from modules import script_callbacks, sd_hijack, shared, hashes
+from pydantic import BaseModel

 from scripts.model_keyword_support import (get_lora_simple_hash,
                                           load_hash_cache, update_hash_cache,
                                           write_model_keyword_path)
 from scripts.shared_paths import *

+try:
+    import scripts.tag_frequency_db as tdb
+
+    # Ensure the db dependency is reloaded on script reload
+    importlib.reload(tdb)
+
+    db = tdb.TagFrequencyDb()
+    if int(db.version) != int(tdb.db_ver):
+        raise ValueError("Database version mismatch")
+except (ImportError, ValueError, sqlite3.Error) as e:
+    print(f"Tag Autocomplete: Tag frequency database error - \"{e}\"")
+    db = None
+
+# Attempt to get embedding load function, using the same call as api.
+try:
+    load_textual_inversion_embeddings = sd_hijack.model_hijack.embedding_db.load_textual_inversion_embeddings
+except Exception as e: # Not supported.
+    load_textual_inversion_embeddings = lambda *args, **kwargs: None
+    print("Tag Autocomplete: Cannot reload embeddings instantly:", e)
+
+# Sorting functions for extra networks / embeddings stuff
+sort_criteria = {
+    "Name": lambda path, name, subpath: name.lower() if subpath else path.stem.lower(),
+    "Date Modified (newest first)": lambda path, name, subpath: path.stat().st_mtime,
+    "Date Modified (oldest first)": lambda path, name, subpath: path.stat().st_mtime
+}
+
+def sort_models(model_list, sort_method = None, name_has_subpath = False):
+    """Sorts models according to the setting.
+    
+    Input: list of (full_path, display_name, {hash}) models. 
+    Returns models in the format of name, sort key, meta.
+    Meta is optional and can be a hash, version string or other required info.
+    """
+    if len(model_list) == 0:
+        return model_list
+
+    if sort_method is None:
+        sort_method = getattr(shared.opts, "tac_modelSortOrder", "Name")
+
+    # Get sorting method from dictionary
+    sorter = sort_criteria.get(sort_method, sort_criteria["Name"])
+
+    # During merging on the JS side we need to re-sort anyway, so here only the sort criteria are calculated.
+    # The list itself doesn't need to get sorted at this point.
+    if len(model_list[0]) > 2:
+        results = [f'{name},"{sorter(path, name, name_has_subpath)}",{meta}' for path, name, meta in model_list]
+    else:
+        results = [f'{name},"{sorter(path, name, name_has_subpath)}"' for path, name in model_list]
+    return results
+

 def get_wildcards():
    """Returns a list of all wildcards. Works on nested folders."""
    wildcard_files = list(WILDCARD_PATH.rglob("*.txt"))
-    resolved = [w.relative_to(WILDCARD_PATH).as_posix(
-    ) for w in wildcard_files if w.name != "put wildcards here.txt"]
-    return resolved
+    resolved = [(w, w.relative_to(WILDCARD_PATH).as_posix())
+                for w in wildcard_files
+                if w.name != "put wildcards here.txt"
+                and w.is_file()]
+    return sort_models(resolved, name_has_subpath=True)


 def get_ext_wildcards():
    """Returns a list of all extension wildcards. Works on nested folders."""
    wildcard_files = []
-
+    excluded_folder_names = [s.strip() for s in getattr(shared.opts, "tac_wildcardExclusionList", "").split(",")]
    for path in WILDCARD_EXT_PATHS:
        wildcard_files.append(path.as_posix())
-        wildcard_files.extend(p.relative_to(path).as_posix() for p in path.rglob("*.txt") if p.name != "put wildcards here.txt")
+        resolved = [(w, w.relative_to(path).as_posix())
+                    for w in path.rglob("*.txt")
+                    if w.name != "put wildcards here.txt"
+                    and not any(excluded in w.parts for excluded in excluded_folder_names)
+                    and w.is_file()]
+        wildcard_files.extend(sort_models(resolved, name_has_subpath=True))
        wildcard_files.append("-----")

    return wildcard_files

+def is_umi_format(data):
+    """Returns True if the YAML file is in UMI format."""
+    issue_found = False
+    for item in data:
+        if not (data[item] and 'Tags' in data[item] and isinstance(data[item]['Tags'], list)):
+            issue_found = True
+            break
+    return not issue_found

-def get_ext_wildcard_tags():
+count = 0
+def parse_umi_format(umi_tags, data):
+    global count
+    for item in data:
+        umi_tags[count] = ','.join(data[item]['Tags'])
+        count += 1
+
+
+def parse_dynamic_prompt_format(yaml_wildcards, data, path):
+    # Recurse subkeys, delete those without string lists as values
+    def recurse_dict(d: dict):
+        for key, value in d.copy().items():
+            if isinstance(value, dict):
+                recurse_dict(value)
+            elif not (isinstance(value, list) and all(isinstance(v, str) for v in value)):
+                del d[key]
+
+    recurse_dict(data)
+    # Add to yaml_wildcards
+    yaml_wildcards[path.name] = data
+
+
+def get_yaml_wildcards():
    """Returns a list of all tags found in extension YAML files found under a Tags: key."""
-    wildcard_tags = {} # { tag: count }
    yaml_files = []
    for path in WILDCARD_EXT_PATHS:
-        yaml_files.extend(p for p in path.rglob("*.yml"))
-        yaml_files.extend(p for p in path.rglob("*.yaml"))
-    count = 0
+        yaml_files.extend(p for p in path.rglob("*.yml") if p.is_file())
+        yaml_files.extend(p for p in path.rglob("*.yaml") if p.is_file())
+
+    yaml_wildcards = {}
+
+    umi_tags = {} # { tag: count }
+
    for path in yaml_files:
        try:
            with open(path, encoding="utf8") as file:
                data = yaml.safe_load(file)
-                if data:
-                    for item in data:
-                        if data[item] and 'Tags' in data[item] and isinstance(data[item]['Tags'], list):
-                            wildcard_tags[count] = ','.join(data[item]['Tags'])
-                            count += 1
-                        else:
-                            print('Issue with tags found in ' + path.name + ' at item ' + item)
+                if (data):
+                    if (is_umi_format(data)):
+                        parse_umi_format(umi_tags, data)
+                    else:
+                        parse_dynamic_prompt_format(yaml_wildcards, data, path)
                else:
                    print('No data found in ' + path.name)
-        except yaml.YAMLError:
-            print('Issue in parsing YAML file ' + path.name                       )
+        except (yaml.YAMLError, UnicodeDecodeError) as e:
+            print(f'Issue in parsing YAML file {path.name}: {e}')
            continue
+
    # Sort by count
-    sorted_tags = sorted(wildcard_tags.items(), key=lambda item: item[1], reverse=True)
-    output = []
-    for tag, count in sorted_tags:
-        output.append(f"{tag},{count}")
-    return output
+    umi_sorted = sorted(umi_tags.items(), key=lambda item: item[1], reverse=True)
+    umi_output = []
+    for tag, count in umi_sorted:
+        umi_output.append(f"{tag},{count}")
+
+    if (len(umi_output) > 0):
+        write_to_temp_file('umi_tags.txt', umi_output)
+
+    with open(TEMP_PATH.joinpath("wc_yaml.json"), "w", encoding="utf-8") as file:
+        json.dump(yaml_wildcards, file, ensure_ascii=False)


 def get_embeddings(sd_model):
@@ -75,48 +174,49 @@ def get_embeddings(sd_model):
    # Version constants
    V1_SHAPE = 768
    V2_SHAPE = 1024
+    VXL_SHAPE = 2048
    emb_v1 = []
    emb_v2 = []
+    emb_vXL = []
+    emb_unknown = []
    results = []

    try:
+        # The sd_model embedding_db reference only exists in sd.next with diffusers backend
+        try:
+            loaded_sdnext = sd_model.embedding_db.word_embeddings
+            skipped_sdnext = sd_model.embedding_db.skipped_embeddings
+        except (NameError, AttributeError):
+            loaded_sdnext = {}
+            skipped_sdnext = {}
+        
        # Get embedding dict from sd_hijack to separate v1/v2 embeddings
-        emb_type_a = sd_hijack.model_hijack.embedding_db.word_embeddings
-        emb_type_b = sd_hijack.model_hijack.embedding_db.skipped_embeddings
-        # Get the shape of the first item in the dict
-        emb_a_shape = -1
-        emb_b_shape = -1
-        if (len(emb_type_a) > 0):
-            emb_a_shape = next(iter(emb_type_a.items()))[1].shape
-        if (len(emb_type_b) > 0):
-            emb_b_shape = next(iter(emb_type_b.items()))[1].shape
+        loaded = sd_hijack.model_hijack.embedding_db.word_embeddings
+        skipped = sd_hijack.model_hijack.embedding_db.skipped_embeddings
+        loaded = loaded | loaded_sdnext
+        skipped = skipped | skipped_sdnext

        # Add embeddings to the correct list
-        if (emb_a_shape == V1_SHAPE):
-            emb_v1 = list(emb_type_a.keys())
-        elif (emb_a_shape == V2_SHAPE):
-            emb_v2 = list(emb_type_a.keys())
+        for key, emb in (loaded | skipped).items():
+            if emb.filename is None:
+                continue

-        if (emb_b_shape == V1_SHAPE):
-            emb_v1 = list(emb_type_b.keys())
-        elif (emb_b_shape == V2_SHAPE):
-            emb_v2 = list(emb_type_b.keys())
+            if emb.shape is None:
+                emb_unknown.append((Path(emb.filename), Path(emb.filename).relative_to(EMB_PATH).as_posix(), ""))
+            elif emb.shape == V1_SHAPE:
+                emb_v1.append((Path(emb.filename), Path(emb.filename).relative_to(EMB_PATH).as_posix(), "v1"))
+            elif emb.shape == V2_SHAPE:
+                emb_v2.append((Path(emb.filename), Path(emb.filename).relative_to(EMB_PATH).as_posix(), "v2"))
+            elif emb.shape == VXL_SHAPE:
+                emb_vXL.append((Path(emb.filename), Path(emb.filename).relative_to(EMB_PATH).as_posix(), "vXL"))
+            else:
+                emb_unknown.append((Path(emb.filename), Path(emb.filename).relative_to(EMB_PATH).as_posix(), ""))

-        # Get shape of current model
-        #vec = sd_model.cond_stage_model.encode_embedding_init_text(",", 1)
-        #model_shape = vec.shape[1]
-        # Show relevant entries at the top
-        #if (model_shape == V1_SHAPE):
-        #    results = [e + ",v1" for e in emb_v1] + [e + ",v2" for e in emb_v2]
-        #elif (model_shape == V2_SHAPE):
-        #    results = [e + ",v2" for e in emb_v2] + [e + ",v1" for e in emb_v1]
-        #else:
-        #    raise AttributeError # Fallback to old method
-        results = sorted([e + ",v1" for e in emb_v1] + [e + ",v2" for e in emb_v2], key=lambda x: x.lower())
+        results = sort_models(emb_v1) + sort_models(emb_v2) + sort_models(emb_vXL) + sort_models(emb_unknown)
    except AttributeError:
        print("tag_autocomplete_helper: Old webui version or unrecognized model shape, using fallback for embedding completion.")
        # Get a list of all embeddings in the folder
-        all_embeds = [str(e.relative_to(EMB_PATH)) for e in EMB_PATH.rglob("*") if e.suffix in {".bin", ".pt", ".png",'.webp', '.jxl', '.avif'}]
+        all_embeds = [str(e.relative_to(EMB_PATH)) for e in EMB_PATH.rglob("*") if e.suffix in {".bin", ".pt", ".png",'.webp', '.jxl', '.avif'} and e.is_file()]
        # Remove files with a size of 0
        all_embeds = [e for e in all_embeds if EMB_PATH.joinpath(e).stat().st_size > 0]
        # Remove file extensions
@@ -130,53 +230,129 @@ def get_hypernetworks():

    # Get a list of all hypernetworks in the folder
    hyp_paths = [Path(h) for h in glob.glob(HYP_PATH.joinpath("**/*").as_posix(), recursive=True)]
-    all_hypernetworks = [str(h.name) for h in hyp_paths if h.suffix in {".pt"}]
-    # Remove file extensions
-    return sorted([h[:h.rfind('.')] for h in all_hypernetworks], key=lambda x: x.lower())
+    all_hypernetworks = [(h, h.stem) for h in hyp_paths if h.suffix in {".pt"} and h.is_file()]
+    return sort_models(all_hypernetworks)

 model_keyword_installed = write_model_keyword_path()
+
+
+def _get_lora():
+    """
+    Write a list of all lora.
+    Fallback method for when the built-in Lora.networks module is not available.
+    """
+    # Get a list of all lora in the folder
+    lora_paths = [
+        Path(l)
+        for l in glob.glob(LORA_PATH.joinpath("**/*").as_posix(), recursive=True)
+    ]
+    # Get hashes
+    valid_loras = [
+        lf
+        for lf in lora_paths
+        if lf.suffix in {".safetensors", ".ckpt", ".pt"} and lf.is_file()
+    ]
+
+    return valid_loras
+
+
+def _get_lyco():
+    """
+    Write a list of all LyCORIS/LOHA from https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris
+    Fallback method for when the built-in Lora.networks module is not available.
+    """
+    # Get a list of all LyCORIS in the folder
+    lyco_paths = [
+        Path(ly)
+        for ly in glob.glob(LYCO_PATH.joinpath("**/*").as_posix(), recursive=True)
+    ]
+
+    # Get hashes
+    valid_lycos = [
+        lyf
+        for lyf in lyco_paths
+        if lyf.suffix in {".safetensors", ".ckpt", ".pt"} and lyf.is_file()
+    ]
+    return valid_lycos
+
+
+# Attempt to use the build-in Lora.networks Lora/LyCORIS models lists.
+try:
+    import sys
+    from modules import extensions
+    sys.path.append(Path(extensions.extensions_builtin_dir).joinpath("Lora").as_posix())
+    import lora # pyright: ignore [reportMissingImports]
+
+    def _get_lora():
+        return [
+            Path(model.filename).absolute()
+            for model in lora.available_loras.values()
+            if Path(model.filename).absolute().is_relative_to(LORA_PATH)
+        ]
+
+    def _get_lyco():
+        return [
+            Path(model.filename).absolute()
+            for model in lora.available_loras.values()
+            if Path(model.filename).absolute().is_relative_to(LYCO_PATH)
+        ]
+
+except Exception as e:
+    pass
+    # no need to report
+    # print(f'Exception setting-up performant fetchers: {e}')
+
+
+def is_visible(p: Path) -> bool:
+    if getattr(shared.opts, "extra_networks_hidden_models", "When searched") != "Never":
+        return True
+    for part in p.parts:
+        if part.startswith('.'):
+            return False
+    return True
+
 def get_lora():
    """Write a list of all lora"""
-    global model_keyword_installed
-
-    # Get a list of all lora in the folder
-    lora_paths = [Path(l) for l in glob.glob(LORA_PATH.joinpath("**/*").as_posix(), recursive=True)]
    # Get hashes
-    valid_loras = [lf for lf in lora_paths if lf.suffix in {".safetensors", ".ckpt", ".pt"}]
-    hashes = {}
+    valid_loras = _get_lora()
+    loras_with_hash = []
    for l in valid_loras:
+        if not l.exists() or not l.is_file() or not is_visible(l):
+            continue
        name = l.relative_to(LORA_PATH).as_posix()
        if model_keyword_installed:
-            hashes[name] = get_lora_simple_hash(l)
+            hash = get_lora_simple_hash(l)
        else:
-            hashes[name] = ""
+            hash = ""
+        loras_with_hash.append((l, name, hash))
    # Sort
-    sorted_loras = dict(sorted(hashes.items()))
-    # Add hashes and return
-    return [f"\"{name}\",{hash}" for name, hash in sorted_loras.items()]
+    return sort_models(loras_with_hash)


 def get_lyco():
    """Write a list of all LyCORIS/LOHA from https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris"""
-
-    # Get a list of all LyCORIS in the folder
-    lyco_paths = [Path(ly) for ly in glob.glob(LYCO_PATH.joinpath("**/*").as_posix(), recursive=True)]
-    
    # Get hashes
-    valid_lycos = [lyf for lyf in lyco_paths if lyf.suffix in {".safetensors", ".ckpt", ".pt"}]
-    hashes = {}
+    valid_lycos = _get_lyco()
+    lycos_with_hash = []
    for ly in valid_lycos:
+        if not ly.exists() or not ly.is_file() or not is_visible(ly):
+            continue
        name = ly.relative_to(LYCO_PATH).as_posix()
        if model_keyword_installed:
-            hashes[name] = get_lora_simple_hash(ly)
+            hash = get_lora_simple_hash(ly)
        else:
-            hashes[name] = ""
-    
+            hash = ""
+        lycos_with_hash.append((ly, name, hash))
    # Sort
-    sorted_lycos = dict(sorted(hashes.items()))
-    # Add hashes and return
-    return [f"\"{name}\",{hash}" for name, hash in sorted_lycos.items()]
+    return sort_models(lycos_with_hash)

+def get_style_names():
+    try:
+        style_names: list[str] = shared.prompt_styles.styles.keys()
+        style_names = sorted(style_names, key=len, reverse=True)
+        return style_names
+    except Exception:
+        return None

 def write_tag_base_path():
    """Writes the tag base path to a fixed location temporary file"""
@@ -192,19 +368,19 @@ def write_to_temp_file(name, data):

 csv_files = []
 csv_files_withnone = []
-def update_tag_files():
+def update_tag_files(*args, **kwargs):
    """Returns a list of all potential tag files"""
    global csv_files, csv_files_withnone
-    files = [str(t.relative_to(TAGS_PATH)) for t in TAGS_PATH.glob("*.csv")]
+    files = [str(t.relative_to(TAGS_PATH)) for t in TAGS_PATH.glob("*.csv") if t.is_file()]
    csv_files = files
    csv_files_withnone = ["None"] + files

 json_files = []
 json_files_withnone = []
-def update_json_files():
+def update_json_files(*args, **kwargs):
    """Returns a list of all potential json files"""
    global json_files, json_files_withnone
-    files = [str(j.relative_to(TAGS_PATH)) for j in TAGS_PATH.glob("*.json")]
+    files = [str(j.relative_to(TAGS_PATH)) for j in TAGS_PATH.glob("*.json") if j.is_file()]
    json_files = files
    json_files_withnone = ["None"] + files

@@ -226,10 +402,12 @@ if not TEMP_PATH.exists():
 # even if no wildcards or embeddings are found
 write_to_temp_file('wc.txt', [])
 write_to_temp_file('wce.txt', [])
-write_to_temp_file('wcet.txt', [])
+write_to_temp_file('wc_yaml.json', [])
+write_to_temp_file('umi_tags.txt', [])
 write_to_temp_file('hyp.txt', [])
 write_to_temp_file('lora.txt', [])
 write_to_temp_file('lyco.txt', [])
+write_to_temp_file('styles.txt', [])
 # Only reload embeddings if the file doesn't exist, since they are already re-written on model load
 if not TEMP_PATH.joinpath("emb.txt").exists():
    write_to_temp_file('emb.txt', [])
@@ -239,26 +417,46 @@ if EMB_PATH.exists():
    # Get embeddings after the model loaded callback
    script_callbacks.on_model_loaded(get_embeddings)

-def refresh_temp_files():
-    write_temp_files()
-    get_embeddings(shared.sd_model)
+def refresh_embeddings(force: bool, *args, **kwargs):
+    try:
+        # Fix for SD.Next infinite refresh loop due to gradio not updating after model load on demand.
+        # This will just skip embedding loading if no model is loaded yet (or there really are no embeddings).
+        # Try catch is just for safety incase sd_hijack access fails for some reason.
+        loaded = sd_hijack.model_hijack.embedding_db.word_embeddings
+        skipped = sd_hijack.model_hijack.embedding_db.skipped_embeddings
+        if len((loaded | skipped)) > 0:
+            load_textual_inversion_embeddings(force_reload=force)
+            get_embeddings(None)
+    except Exception:
+        pass

-def write_temp_files():
+def refresh_temp_files(*args, **kwargs):
+    global WILDCARD_EXT_PATHS
+    skip_wildcard_refresh = getattr(shared.opts, "tac_skipWildcardRefresh", False)
+    if skip_wildcard_refresh:
+        WILDCARD_EXT_PATHS = find_ext_wildcard_paths()
+    write_temp_files(skip_wildcard_refresh)
+    refresh_embeddings(force=True)
+
+def write_style_names(*args, **kwargs):
+    styles = get_style_names()
+    if styles:
+        write_to_temp_file('styles.txt', styles)
+
+def write_temp_files(skip_wildcard_refresh = False):
    # Write wildcards to wc.txt if found
-    if WILDCARD_PATH.exists():
+    if WILDCARD_PATH.exists() and not skip_wildcard_refresh:
        wildcards = [WILDCARD_PATH.relative_to(FILE_DIR).as_posix()] + get_wildcards()
        if wildcards:
            write_to_temp_file('wc.txt', wildcards)

    # Write extension wildcards to wce.txt if found
-    if WILDCARD_EXT_PATHS is not None:
+    if WILDCARD_EXT_PATHS is not None and not skip_wildcard_refresh:
        wildcards_ext = get_ext_wildcards()
        if wildcards_ext:
            write_to_temp_file('wce.txt', wildcards_ext)
-        # Write yaml extension wildcards to wcet.txt if found
-        wildcards_yaml_ext = get_ext_wildcard_tags()
-        if wildcards_yaml_ext:
-            write_to_temp_file('wcet.txt', wildcards_yaml_ext)
+        # Write yaml extension wildcards to umi_tags.txt and wc_yaml.json if found
+        get_yaml_wildcards()

    if HYP_PATH.exists():
        hypernets = get_hypernetworks()
@@ -273,7 +471,7 @@ def write_temp_files():
        lora = get_lora()
        if lora:
            write_to_temp_file('lora.txt', lora)
-            
+
    lyco_exists = LYCO_PATH is not None and LYCO_PATH.exists()
    if lyco_exists and not (lora_exists and LYCO_PATH.samefile(LORA_PATH)):
        lyco = get_lyco()
@@ -285,6 +483,8 @@ def write_temp_files():
    if model_keyword_installed:
        update_hash_cache()

+    if shared.prompt_styles is not None:
+        write_style_names()

 write_temp_files()

@@ -304,6 +504,13 @@ def on_ui_settings():
            return self
        shared.OptionInfo.needs_restart = needs_restart

+    # Dictionary of function options and their explanations
+    frequency_sort_functions = {
+        "Logarithmic (weak)": "Will respect the base order and slightly prefer often used tags",
+        "Logarithmic (strong)": "Same as Logarithmic (weak), but with a stronger bias",
+        "Usage first": "Will list used tags by frequency before all others",
+    }
+
    tac_options = {
        # Main tag file
        "tac_tagFile": shared.OptionInfo("danbooru.csv", "Tag filename", gr.Dropdown, lambda: {"choices": csv_files_withnone}, refresh=update_tag_files),
@@ -322,11 +529,26 @@ def on_ui_settings():
        "tac_resultStepLength": shared.OptionInfo(100, "How many results to load at once"),
        "tac_delayTime": shared.OptionInfo(100, "Time in ms to wait before triggering completion again").needs_restart(),
        "tac_useWildcards": shared.OptionInfo(True, "Search for wildcards"),
+        "tac_sortWildcardResults": shared.OptionInfo(True, "Sort wildcard file contents alphabetically").info("If your wildcard files have a specific custom order, disable this to keep it"),
+        "tac_wildcardExclusionList": shared.OptionInfo("", "Wildcard folder exclusion list").info("Add folder names that shouldn't be searched for wildcards, separated by comma.").needs_restart(),
+        "tac_skipWildcardRefresh": shared.OptionInfo(False, "Don't re-scan for wildcard files when pressing the extra networks refresh button").info("Useful to prevent hanging if you use a very large wildcard collection."),
        "tac_useEmbeddings": shared.OptionInfo(True, "Search for embeddings"),
+        "tac_includeEmbeddingsInNormalResults": shared.OptionInfo(False, "Include embeddings in normal tag results").info("The 'JumpTo...' keybinds (End & Home key by default) will select the first non-embedding result of their direction on the first press for quick navigation in longer lists."),
        "tac_useHypernetworks": shared.OptionInfo(True, "Search for hypernetworks"),
        "tac_useLoras": shared.OptionInfo(True, "Search for Loras"),
        "tac_useLycos": shared.OptionInfo(True, "Search for LyCORIS/LoHa"),
+        "tac_useLoraPrefixForLycos": shared.OptionInfo(True, "Use the '<lora:' prefix instead of '<lyco:' for models in the LyCORIS folder").info("The lyco prefix is included for backwards compatibility and not used anymore by default. Disable this if you are on an old webui version without built-in lyco support."),
        "tac_showWikiLinks": shared.OptionInfo(False, "Show '?' next to tags, linking to its Danbooru or e621 wiki page").info("Warning: This is an external site and very likely contains NSFW examples!"),
+        "tac_showExtraNetworkPreviews": shared.OptionInfo(True, "Show preview thumbnails for extra networks if available"),
+        "tac_modelSortOrder": shared.OptionInfo("Name", "Model sort order", gr.Dropdown, lambda: {"choices": list(sort_criteria.keys())}).info("Order for extra network models and wildcards in dropdown"),
+        "tac_useStyleVars": shared.OptionInfo(False, "Search for webui style names").info("Suggests style names from the webui dropdown with '$'. Currently requires a secondary extension like <a href=\"https://github.com/SirVeggie/extension-style-vars\" target=\"_blank\">style-vars</a> to actually apply the styles before generating."),
+        # Frequency sorting settings
+        "tac_frequencySort": shared.OptionInfo(True, "Locally record tag usage and sort frequent tags higher").info("Will also work for extra networks, keeping the specified base order"),
+        "tac_frequencyFunction": shared.OptionInfo("Logarithmic (weak)", "Function to use for frequency sorting", gr.Dropdown, lambda: {"choices": list(frequency_sort_functions.keys())}).info("; ".join([f'<b>{key}</b>: {val}' for key, val in frequency_sort_functions.items()])),
+        "tac_frequencyMinCount": shared.OptionInfo(3, "Minimum number of uses for a tag to be considered frequent").info("Tags with less uses than this will not be sorted higher, even if the sorting function would normally result in a higher position."),
+        "tac_frequencyMaxAge": shared.OptionInfo(30, "Maximum days since last use for a tag to be considered frequent").info("Similar to the above, tags that haven't been used in this many days will not be sorted higher. Set to 0 to disable."),
+        "tac_frequencyRecommendCap": shared.OptionInfo(10, "Maximum number of recommended tags").info("Limits the maximum number of recommended tags to not drown out normal results. Set to 0 to disable."),
+        "tac_frequencyIncludeAlias": shared.OptionInfo(False, "Frequency sorting matches aliases for frequent tags").info("Tag frequency will be increased for the main tag even if an alias is used for completion. This option can be used to override the default behavior of alias results being ignored for frequency sorting."),
        # Insertion related settings
        "tac_replaceUnderscores": shared.OptionInfo(True, "Replace underscores with spaces on insertion"),
        "tac_escapeParentheses": shared.OptionInfo(True, "Escape parentheses on insertion"),
@@ -334,6 +556,7 @@ def on_ui_settings():
        "tac_appendSpace": shared.OptionInfo(True, "Append space on tag autocompletion").info("will append after comma if the above is enabled"),
        "tac_alwaysSpaceAtEnd": shared.OptionInfo(True, "Always append space if inserting at the end of the textbox").info("takes precedence over the regular space setting for that position"),
        "tac_modelKeywordCompletion": shared.OptionInfo("Never", "Try to add known trigger words for LORA/LyCO models", gr.Dropdown, lambda: {"choices": ["Never","Only user list","Always"]}).info("Will use & prefer the native activation keywords settable in the extra networks UI. Other functionality requires the <a href=\"https://github.com/mix1009/model-keyword\" target=\"_blank\">model-keyword</a> extension to be installed, but will work with it disabled.").needs_restart(),
+        "tac_modelKeywordLocation": shared.OptionInfo("Start of prompt", "Where to insert the trigger keyword", gr.Dropdown, lambda: {"choices": ["Start of prompt","End of prompt","Before LORA/LyCO"]}).info("Only relevant if the above option is enabled"),
        "tac_wildcardCompletionMode": shared.OptionInfo("To next folder level", "How to complete nested wildcard paths", gr.Dropdown, lambda: {"choices": ["To next folder level","To first difference","Always fully"]}).info("e.g. \"hair/colours/light/...\""),
        # Alias settings
        "tac_alias.searchByAlias": shared.OptionInfo(True, "Search by alias"),
@@ -390,6 +613,20 @@ def on_ui_settings():
        "6": ["red", "maroon"],
        "7": ["whitesmoke", "black"],
        "8": ["seagreen", "darkseagreen"]
+    },
+    "derpibooru": {
+        "-1": ["red", "maroon"],
+        "0": ["#60d160", "#3d9d3d"],
+        "1": ["#fff956", "#918e2e"],
+        "3": ["#fd9961", "#a14c2e"],
+        "4": ["#cf5bbe", "#6c1e6c"],
+        "5": ["#3c8ad9", "#1e5e93"],
+        "6": ["#a6a6a6", "#555555"],
+        "7": ["#47abc1", "#1f6c7c"],
+        "8": ["#7871d0", "#392f7d"],
+        "9": ["#df3647", "#8e1c2b"],
+        "10": ["#c98f2b", "#7b470e"],
+        "11": ["#e87ebe", "#a83583"]
    }
 }\
 """
@@ -404,38 +641,184 @@ def on_ui_settings():
        shared.opts.add_option("tac_colormap", shared.OptionInfo(colorDefault, colorLabel, gr.Textbox, section=TAC_SECTION))

    shared.opts.add_option("tac_refreshTempFiles", shared.OptionInfo("Refresh TAC temp files", "Refresh internal temp files", gr.HTML, {}, refresh=refresh_temp_files, section=TAC_SECTION))
-    
+
 script_callbacks.on_ui_settings(on_ui_settings)

-def api_tac(_: gr.Blocks, app: FastAPI):
-    async def get_json_info(path: Path):
-        if not path:
-            return json.dumps({})
+def get_style_mtime():
+    try:
+        style_file = getattr(shared, "styles_filename", "styles.csv")
+        # Check in case a list is returned
+        if isinstance(style_file, list):
+            style_file = style_file[0]
        
-        try:
-            if path is not None and path.exists() and path.parent.joinpath(path.stem + ".json").exists():
-                return FileResponse(path.parent.joinpath(path.stem + ".json").as_posix())
-        except Exception as e:
-            return json.dumps({"error": e})
+        style_file = Path(FILE_DIR).joinpath(style_file)
+        if Path.exists(style_file):
+            return style_file.stat().st_mtime
+    except Exception:
+        return None

-    @app.get("/tacapi/v1/lora-info/{folder}/{lora_name}")
-    async def get_lora_info_subfolder(folder, lora_name):
-        if LORA_PATH is None:
-            return json.dumps({})
-        return await get_json_info(LORA_PATH.joinpath(folder).joinpath(lora_name))
-    
-    @app.get("/tacapi/v1/lyco-info/{folder}/{lyco_name}")
-    async def get_lyco_info_subfolder(folder, lyco_name):
-        if LYCO_PATH is None:
-            return json.dumps({})
-        return await get_json_info(LYCO_PATH.joinpath(folder).joinpath(lyco_name))
+last_style_mtime = get_style_mtime()
+
+def api_tac(_: gr.Blocks, app: FastAPI):
+    async def get_json_info(base_path: Path, filename: str = None):
+        if base_path is None or (not base_path.exists()):
+            return Response(status_code=404)
+
+        try:
+            json_candidates = glob.glob(base_path.as_posix() + f"/**/{filename}.json", recursive=True)
+            if json_candidates is not None and len(json_candidates) > 0 and Path(json_candidates[0]).is_file():
+                return FileResponse(json_candidates[0])
+        except Exception as e:
+            return JSONResponse({"error": e}, status_code=500)
+
+    async def get_preview_thumbnail(base_path: Path, filename: str = None, blob: bool = False):
+        if base_path is None or (not base_path.exists()):
+            return Response(status_code=404)
+
+        try:
+            img_glob = glob.glob(base_path.as_posix() + f"/**/{filename}.*", recursive=True)
+            img_candidates = [img for img in img_glob if Path(img).suffix in [".png", ".jpg", ".jpeg", ".webp", ".gif"] and Path(img).is_file()]
+            if img_candidates is not None and len(img_candidates) > 0:
+                if blob:
+                    return FileResponse(img_candidates[0])
+                else:
+                    return JSONResponse({"url": urllib.parse.quote(img_candidates[0])})
+        except Exception as e:
+            return JSONResponse({"error": e}, status_code=500)
+
+    @app.post("/tacapi/v1/refresh-temp-files")
+    async def api_refresh_temp_files():
+        refresh_temp_files()
+
+    @app.post("/tacapi/v1/refresh-embeddings")
+    async def api_refresh_embeddings():
+        refresh_embeddings(force=False)

    @app.get("/tacapi/v1/lora-info/{lora_name}")
    async def get_lora_info(lora_name):
-        return await get_lora_info_subfolder(".", lora_name)
-    
+        return await get_json_info(LORA_PATH, lora_name)
+
    @app.get("/tacapi/v1/lyco-info/{lyco_name}")
    async def get_lyco_info(lyco_name):
-        return await get_lyco_info_subfolder(".", lyco_name)
+        return await get_json_info(LYCO_PATH, lyco_name)

-script_callbacks.on_app_started(api_tac)
+    @app.get("/tacapi/v1/lora-cached-hash/{lora_name}")
+    async def get_lora_cached_hash(lora_name: str):
+        path_glob = glob.glob(LORA_PATH.as_posix() + f"/**/{lora_name}.*", recursive=True)
+        paths = [lora for lora in path_glob if Path(lora).suffix in [".safetensors", ".ckpt", ".pt"] and Path(lora).is_file()]
+        if paths is not None and len(paths) > 0:
+            path = paths[0]
+            hash = hashes.sha256_from_cache(path, f"lora/{lora_name}", path.endswith(".safetensors"))
+            if hash is not None:
+                return hash
+        
+        return None
+
+    def get_path_for_type(type):
+        if type == "lora":
+            return LORA_PATH
+        elif type == "lyco":
+            return LYCO_PATH
+        elif type == "hyper":
+            return HYP_PATH
+        elif type == "embed":
+            return EMB_PATH
+        else:
+            return None
+
+    @app.get("/tacapi/v1/thumb-preview/{filename}")
+    async def get_thumb_preview(filename, type):
+        return await get_preview_thumbnail(get_path_for_type(type), filename, False)
+
+    @app.get("/tacapi/v1/thumb-preview-blob/{filename}")
+    async def get_thumb_preview_blob(filename, type):
+        return await get_preview_thumbnail(get_path_for_type(type), filename, True)
+
+    @app.get("/tacapi/v1/wildcard-contents")
+    async def get_wildcard_contents(basepath: str, filename: str):
+        if basepath is None or basepath == "":
+            return Response(status_code=404)
+
+        base = Path(basepath)
+        if base is None or (not base.exists()):
+            return Response(status_code=404)
+
+        try:
+            wildcard_path = base.joinpath(filename)
+            if wildcard_path.exists() and wildcard_path.is_file():
+                return FileResponse(wildcard_path)
+            else:
+                return Response(status_code=404)
+        except Exception as e:
+            return JSONResponse({"error": e}, status_code=500)
+
+    @app.get("/tacapi/v1/refresh-styles-if-changed")
+    async def refresh_styles_if_changed():
+        global last_style_mtime
+        
+        mtime = get_style_mtime()
+        if mtime is not None and mtime > last_style_mtime:
+            last_style_mtime = mtime
+            # Update temp file
+            if shared.prompt_styles is not None:
+                write_style_names()
+            
+            return Response(status_code=200) # Success
+        else:
+            return Response(status_code=304) # Not modified
+    def db_request(func, get = False):
+        if db is not None:
+            try:
+                if get:
+                    ret = func()
+                    if ret is list:
+                        ret = [{"name": t[0], "type": t[1], "count": t[2], "lastUseDate": t[3]} for t in ret]
+                    return JSONResponse({"result": ret})
+                else:
+                    func()
+            except sqlite3.Error as e:
+                return JSONResponse({"error": e.__cause__}, status_code=500)
+        else:
+            return JSONResponse({"error": "Database not initialized"}, status_code=500)
+
+    @app.post("/tacapi/v1/increase-use-count")
+    async def increase_use_count(tagname: str, ttype: int, neg: bool):
+        db_request(lambda: db.increase_tag_count(tagname, ttype, neg))
+
+    @app.get("/tacapi/v1/get-use-count")
+    async def get_use_count(tagname: str, ttype: int, neg: bool):
+        return db_request(lambda: db.get_tag_count(tagname, ttype, neg), get=True)
+    
+    # Small dataholder class
+    class UseCountListRequest(BaseModel):
+        tagNames: list[str]
+        tagTypes: list[int]
+        neg: bool = False
+
+    # Semantically weird to use post here, but it's required for the body on js side
+    @app.post("/tacapi/v1/get-use-count-list")
+    async def get_use_count_list(body: UseCountListRequest):
+        # If a date limit is set > 0, pass it to the db
+        date_limit = getattr(shared.opts, "tac_frequencyMaxAge", 30)
+        date_limit = date_limit if date_limit > 0 else None
+
+        count_list = list(db.get_tag_counts(body.tagNames, body.tagTypes, body.neg, date_limit))
+    
+        # If a limit is set, return at max the top n results by count
+        if count_list and len(count_list):
+            limit = int(min(getattr(shared.opts, "tac_frequencyRecommendCap", 10), len(count_list)))
+            # Sort by count and return the top n
+            if limit > 0:
+                count_list = sorted(count_list, key=lambda x: x[2], reverse=True)[:limit]
+
+        return db_request(lambda: count_list, get=True)
+
+    @app.put("/tacapi/v1/reset-use-count")
+    async def reset_use_count(tagname: str, ttype: int, pos: bool, neg: bool):
+        db_request(lambda: db.reset_tag_count(tagname, ttype, pos, neg))
+
+    @app.get("/tacapi/v1/get-all-use-counts")
+    async def get_all_tag_counts():
+        return db_request(lambda: db.get_all_tags(), get=True)
+        
+script_callbacks.on_app_started(api_tac)
--- a/scripts/tag_frequency_db.py
+++ b/scripts/tag_frequency_db.py
@@ -0,0 +1,189 @@
+import sqlite3
+from contextlib import contextmanager
+
+from scripts.shared_paths import TAGS_PATH
+
+db_file = TAGS_PATH.joinpath("tag_frequency.db")
+timeout = 30
+db_ver = 1
+
+
+@contextmanager
+def transaction(db=db_file):
+    """Context manager for database transactions.
+    Ensures that the connection is properly closed after the transaction.
+    """
+    try:
+        conn = sqlite3.connect(db, timeout=timeout)
+        
+        conn.isolation_level = None
+        cursor = conn.cursor()
+        cursor.execute("BEGIN")
+        yield cursor
+        cursor.execute("COMMIT")
+    except sqlite3.Error as e:
+        print("Tag Autocomplete: Frequency database error:", e)
+    finally:
+        if conn:
+            conn.close()
+
+
+class TagFrequencyDb:
+    """Class containing creation and interaction methods for the tag frequency database"""
+
+    def __init__(self) -> None:
+        self.version = self.__check()
+
+    def __check(self):
+        if not db_file.exists():
+            print("Tag Autocomplete: Creating frequency database")
+            with transaction() as cursor:
+                self.__create_db(cursor)
+                self.__update_db_data(cursor, "version", db_ver)
+            print("Tag Autocomplete: Database successfully created")
+
+        return self.__get_version()
+
+    def __create_db(self, cursor: sqlite3.Cursor):
+        cursor.execute(
+            """
+        CREATE TABLE IF NOT EXISTS db_data (
+            key TEXT PRIMARY KEY,
+            value TEXT
+        )
+        """
+        )
+
+        cursor.execute(
+            """
+        CREATE TABLE IF NOT EXISTS tag_frequency (
+            name TEXT NOT NULL,
+            type INT NOT NULL,
+            count_pos INT,
+            count_neg INT,
+            last_used TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
+            PRIMARY KEY (name, type)
+        )
+        """
+        )
+
+    def __update_db_data(self, cursor: sqlite3.Cursor, key, value):
+        cursor.execute(
+            """
+        INSERT OR REPLACE
+        INTO db_data (key, value)
+        VALUES (?, ?)
+        """,
+            (key, value),
+        )
+
+    def __get_version(self):
+        with transaction() as cursor:
+            cursor.execute(
+                """
+            SELECT value
+            FROM db_data
+            WHERE key = 'version'
+            """
+            )
+            db_version = cursor.fetchone()
+
+        return db_version[0] if db_version else 0
+
+    def get_all_tags(self):
+        with transaction() as cursor:
+            cursor.execute(
+                f"""
+            SELECT name, type, count_pos, count_neg, last_used
+            FROM tag_frequency
+            WHERE count_pos > 0 OR count_neg > 0
+            ORDER BY count_pos + count_neg DESC
+            """
+            )
+            tags = cursor.fetchall()
+
+        return tags
+
+    def get_tag_count(self, tag, ttype, negative=False):
+        count_str = "count_neg" if negative else "count_pos"
+        with transaction() as cursor:
+            cursor.execute(
+                f"""
+            SELECT {count_str}, last_used
+            FROM tag_frequency
+            WHERE name = ? AND type = ?
+            """,
+                (tag, ttype),
+            )
+            tag_count = cursor.fetchone()
+
+        if tag_count:
+            return tag_count[0], tag_count[1]
+        else:
+            return 0, None
+
+    def get_tag_counts(self, tags: list[str], ttypes: list[str], negative=False, date_limit=None):
+        count_str = "count_neg" if negative else "count_pos"
+        with transaction() as cursor:
+            for tag, ttype in zip(tags, ttypes):
+                if date_limit is not None:
+                    cursor.execute(
+                        f"""
+                    SELECT {count_str}, last_used
+                    FROM tag_frequency
+                    WHERE name = ? AND type = ?
+                    AND last_used > datetime('now', '-' || ? || ' days')
+                    """,
+                        (tag, ttype, date_limit),
+                    )
+                else:
+                    cursor.execute(
+                        f"""
+                    SELECT {count_str}, last_used
+                    FROM tag_frequency
+                    WHERE name = ? AND type = ?
+                    """,
+                        (tag, ttype),
+                    )
+                tag_count = cursor.fetchone()
+                if tag_count:
+                    yield (tag, ttype, tag_count[0], tag_count[1]) 
+                else:
+                    yield (tag, ttype, 0, None)
+
+    def increase_tag_count(self, tag, ttype, negative=False):
+        pos_count = self.get_tag_count(tag, ttype, False)[0]
+        neg_count = self.get_tag_count(tag, ttype, True)[0]
+
+        if negative:
+            neg_count += 1
+        else:
+            pos_count += 1
+
+        with transaction() as cursor:
+            cursor.execute(
+                f"""
+            INSERT OR REPLACE
+            INTO tag_frequency (name, type, count_pos, count_neg)
+            VALUES (?, ?, ?, ?)
+            """,
+                (tag, ttype, pos_count, neg_count),
+            )
+
+    def reset_tag_count(self, tag, ttype, positive=True, negative=False):
+        if positive and negative:
+            set_str = "count_pos = 0, count_neg = 0"
+        elif positive:
+            set_str = "count_pos = 0"
+        elif negative:
+            set_str = "count_neg = 0"
+
+        with transaction() as cursor:
+            cursor.execute(
+                f"""
+            UPDATE tag_frequency
+            SET {set_str}
+            WHERE name = ? AND type = ?
+            """,
+                (tag, ttype),
+            )
--- a/tags/EnglishDictionary.csv
+++ b/tags/EnglishDictionary.csv
--- a/tags/danbooru.csv
+++ b/tags/danbooru.csv
--- a/tags/derpibooru.csv
+++ b/tags/derpibooru.csv
--- a/tags/e621_sfw.csv
+++ b/tags/e621_sfw.csv
Author	SHA1	Message	Date
DominikDoom	119a3ad51f	Merge branch 'feature-sort-by-frequent-use'	2024-04-13 15:08:57 +02:00
DominikDoom	c820a22149	Merge branch 'main' into feature-sort-by-frequent-use	2024-04-13 15:06:53 +02:00
DominikDoom	eb1e1820f9	English dictionary and derpibooru tag lists, thanks to @Nenotriple Closes #280	2024-04-13 14:42:21 +02:00
DominikDoom	ef59cff651	Move last used date check guard to SQL side, implement max cap - Server side date comparison and cap check further improve js sort performance - The alias check has also been moved out of calculateUsageBias to support the new cap system	2024-03-16 16:44:43 +01:00
DominikDoom	a454383c43	Merge branch 'main' into feature-sort-by-frequent-use	2024-03-03 13:52:32 +01:00
DominikDoom	bec567fe26	Merge pull request #277 from Symbiomatrix/embpath Embedding relative path.	2024-03-03 13:50:33 +01:00
DominikDoom	d4041096c9	Merge pull request #275 from Symbiomatrix/wildcard	2024-03-03 13:43:27 +01:00
Symbiomatrix	0903259ddf	Update ext_embeddings.js	2024-03-03 13:49:36 +02:00
Symbiomatrix	f3e64b1fa5	Update tag_autocomplete_helper.py	2024-03-03 13:47:39 +02:00
DominikDoom	312cec5d71	Merge pull request #276 from Symbiomatrix/modkey [Feature] Modifier keys for list navigation.	2024-03-03 11:46:05 +01:00
Symbiomatrix	b71e6339bd	Fix tabs.	2024-03-03 12:21:29 +02:00
Symbiomatrix	7ddbc3c0b2	Update tagAutocomplete.js	2024-03-03 04:23:13 +02:00
DominikDoom	4c2ef8f770	Merge branch 'main' into feature-sort-by-frequent-use	2024-02-09 19:23:52 +01:00
DominikDoom	97c5e4f53c	Fix embeddings not loading in SD.Next diffusers backend Fixes #273	2024-02-09 19:06:23 +01:00
DominikDoom	1d8d9f64b5	Update danbooru.csv with 2023 data Closes #274	2024-02-09 17:59:06 +01:00
DominikDoom	7437850600	Merge branch 'main' into feature-sort-by-frequent-use	2024-02-04 14:46:29 +01:00
DominikDoom	829a4a7b89	Merge pull request #272 from rkfg/lora-visibility Hide loras according to settings	2024-02-04 14:45:48 +01:00
rkfg	22472ac8ad	Hide loras according to settings	2024-02-04 16:44:33 +03:00
DominikDoom	5f77fa26d3	Update README.md Add feedback wanted notice	2024-02-04 12:04:02 +01:00
DominikDoom	f810b2dd8f	Merge branch 'main' into feature-sort-by-frequent-use	2024-01-27 12:39:40 +01:00
DominikDoom	08d3436f3b	Fix mtime check for list return Fixes #269	2024-01-27 12:38:08 +01:00
DominikDoom	afa13306ef	Small regex fix to make style completion work after [ or before ,	2024-01-26 20:39:33 +01:00
DominikDoom	95200e82e1	Merge branch 'main' into feature-sort-by-frequent-use	2024-01-26 17:04:53 +01:00
DominikDoom	a63ce64f4e	Small fix for nonexistent style file	2024-01-26 17:04:15 +01:00
DominikDoom	a966be7546	Merge branch 'main' into feature-sort-by-frequent-use	2024-01-26 16:21:15 +01:00
DominikDoom	d37e37acfa	Added option to autocomplete style names To be used in tandem with https://github.com/SirVeggie/extension-style-vars Closes #268	2024-01-26 16:16:04 +01:00
DominikDoom	342fbc9041	Pre-calculate usage bias for all results instead of in the sort function Roughly doubles the sort performance	2024-01-19 21:10:09 +01:00
DominikDoom	d496569c9a	Cache sort key for small performance increase	2024-01-19 20:17:14 +01:00
DominikDoom	7778142520	Same fix for embeddings and chants, although probably not relevant	2024-01-11 15:42:30 +01:00
DominikDoom	cde90c13c4	Fix wildcards being cut off after colon Fixes #267	2024-01-11 15:42:30 +01:00
DominikDoom	231b121fe0	Update README Updated English and Japanese READMEs to include link to Japanese tag translations	2024-01-09 11:54:07 +01:00
DominikDoom	c659ed2155	Use <lora: for models in lycoris folder by default Added a backcompat option to keep using <lyco: if needed. Closes #263	2023-12-24 14:11:19 +01:00
DominikDoom	0a4c17cada	Merge pull request #261 from Jibaku789/main Add support of deepdanbooru-object-recognition	2023-12-19 11:01:53 +01:00
Jibaku789	6e65811d4a	Add support of deepdanbooru-object-recognition Add support of autocomplete in extension; deepdanbooru-object-recognition	2023-12-18 15:57:00 -06:00
DominikDoom	03673c060e	Add wildcard exclusion options One for excluding specific folders by name, the other to skip them during refresh	2023-12-15 19:46:17 +01:00
DominikDoom	1c11c4ad5a	Lora hash dict safety checks	2023-12-15 13:35:53 +01:00
DominikDoom	30c9593d3d	Merge branch 'main' into feature-sort-by-frequent-use	2023-12-12 14:23:18 +01:00
DominikDoom	f840586b6b	Auto-refresh embedding list after model change Uses own API endpoint and doesn't force-reload to skip unneeded work (only works for A1111 as SD.Next model change detection isn't implemented yet)	2023-12-12 14:22:53 +01:00
DominikDoom	886704e351	Fix lora import in a1111 This makes the built-in list method work on the initial load there	2023-12-12 13:46:51 +01:00
DominikDoom	41626d22c3	Fix refresh in SD.Next if no model was loaded	2023-12-12 12:15:58 +01:00
DominikDoom	57076060df	Merge branch 'main' into feature-sort-by-frequent-use	2023-12-11 11:43:26 +01:00
DominikDoom	5ef346cde3	Attempt to use the build-in Lora.networks Lora/LyCORIS models lists (#258 ) Co-authored-by: Midcoastal <midcoastal79@gmail.com>	2023-12-11 11:37:12 +01:00
DominikDoom	edf76d9df2	Revert "Attempt to use the build-in Lora.networks Lora/LyCORIS models lists (#255 )" This reverts commit `837dc39811`.	2023-12-10 22:49:30 +01:00
Mike	837dc39811	Attempt to use the build-in Lora.networks Lora/LyCORIS models lists (#255 )	2023-12-10 22:20:51 +01:00
DominikDoom	f1870b7e87	Force text color to account for themes not following gradio settings As discussed in PR #256	2023-12-10 15:30:49 +01:00
DominikDoom	20b6635a2a	WIP usage info table Might get replaced with gradio depending on how well it works	2023-12-04 15:00:19 +01:00
DominikDoom	1fe8f26670	Add explanatory tooltip and inline reset ability Also add tooltip for wiki links	2023-12-04 13:56:15 +01:00
DominikDoom	e82e958c3e	Fix alias check for non-aliased tag types	2023-11-29 18:15:59 +01:00
DominikDoom	2dd48eab79	Fix error with db return value for no matches	2023-11-29 18:14:14 +01:00
DominikDoom	4df90f5c95	Don't frequency sort alias results by default with an option to enable it if desired	2023-11-29 18:04:50 +01:00
DominikDoom	a156214a48	Last used & min count settings Also some performance improvements	2023-11-29 17:45:51 +01:00
DominikDoom	15478e73b5	Count positive / negative prompt usage separately	2023-11-29 15:22:41 +01:00
DominikDoom	fcacf7dd66	Update README_ZH.md Added warning about IDM integration blocking JavaScript	2023-11-19 13:20:06 +01:00
DominikDoom	82f819f336	Move file to correct location	2023-11-18 11:59:37 +01:00
Yuxi Liu	effda54526	e621 sfw version	2023-11-18 11:59:37 +01:00
DominikDoom	434301738a	Merge branch 'main' into feature-sort-by-frequent-use	2023-11-05 13:30:51 +01:00
DominikDoom	58804796f0	Fix broken refresh buttons Likely caused by gradio changes	2023-11-05 13:07:47 +01:00
DominikDoom	668ca800b8	Add is_file checks to all glob searches Prevents folder names containing the suffix from breaking things Fixes #251	2023-11-05 12:51:51 +01:00
DominikDoom	a7233a594f	Escape $ signs for the insert functions Fixes #248, as discussed in #247	2023-10-14 16:19:34 +02:00
DominikDoom	4fba7baa69	Merge branch 'main' into feature-sort-by-frequent-use	2023-10-06 18:36:24 +02:00
DominikDoom	5ebe22ddfc	Add sha256 (V2) keyword lookup As discussed in #245	2023-10-06 16:46:18 +02:00
DominikDoom	44c5450b28	Fix special characters breaking wiki link urls	2023-10-06 14:54:29 +02:00
DominikDoom	5fd48f53de	Fix csv parsing for unclosed quotes Fixes #245	2023-10-06 14:44:03 +02:00
DominikDoom	7128efc4f4	Apply same fix to extra tags Count now defaults to max safe integer, which simplifies the sort function Before, it resulted in really bad performance	2023-10-02 00:45:48 +02:00
DominikDoom	bd0ddfbb24	Fix embeddings not at top (only affecting the "include embeddings in normal results" option)	2023-10-02 00:16:58 +02:00
DominikDoom	3108daf0e8	Remove kaomoji inclusion in < search because it interfered with use count searching and is not commonly needed	2023-10-01 23:51:35 +02:00
DominikDoom	446ac14e7f	Fix umi list not resetting after deleting chars behind "["	2023-10-01 23:47:02 +02:00
DominikDoom	363895494b	Fix hide after insert race condition	2023-10-01 23:17:12 +02:00
DominikDoom	04551a8132	Don't await increase, limit to 2k for performance	2023-10-01 22:59:28 +02:00
DominikDoom	ffc0e378d3	Add different sorting functions	2023-10-01 22:44:35 +02:00
DominikDoom	440f109f1f	Use POST + body to get around URL length limit	2023-10-01 22:30:47 +02:00
DominikDoom	80fb247dbe	Sort results by usage count	2023-10-01 21:44:24 +02:00
DominikDoom	b3e71e840d	Safety check for missing shape	2023-09-26 15:12:29 +02:00
DominikDoom	998514bebb	Proper support for SDXL embeddings Now in their own category, other embeddings don't get mislabeled anymore if an XL model is loaded	2023-09-26 14:14:20 +02:00
DominikDoom	d7e98200a8	Use count increase logic	2023-09-26 12:20:15 +02:00
DominikDoom	ac790c8ede	Return dict instead of array for clarity	2023-09-26 12:12:46 +02:00
DominikDoom	22365ec8d6	Add missing type return to list request	2023-09-26 12:02:36 +02:00
DominikDoom	030a83aa4d	Use query parameter instead of path to fix wildcard subfolder issues	2023-09-26 11:55:12 +02:00
DominikDoom	460d32a4ed	Ensure proper reload, fix error message	2023-09-26 11:45:42 +02:00
DominikDoom	581bf1e6a4	Use composite key with name & type to prevent collisions	2023-09-26 11:35:24 +02:00
DominikDoom	74ea5493e5	Add rest of utils functions	2023-09-26 10:58:46 +02:00
DominikDoom	94ec8884c3	Fix SD.Next error caused by embeddings without filenames This only ignores these embeddings, the root cause is a bug / behavioral difference in SD.Next Fixes #242	2023-09-26 10:30:01 +02:00
DominikDoom	6cf9acd6ab	Catch sqlite exceptions, add tag list endpoint	2023-09-24 20:06:40 +02:00
DominikDoom	109a8a155e	Change endpoint name for consistency	2023-09-24 18:00:41 +02:00
DominikDoom	3caa1b51ed	Add db to gitignore	2023-09-24 17:59:39 +02:00
DominikDoom	b44c36425a	Fix db load version comparison, add sort options	2023-09-24 17:59:14 +02:00
DominikDoom	1e81403180	Safety catches for DB API access	2023-09-24 16:50:39 +02:00
DominikDoom	0f487a5c5c	WIP database setup inspired by ImageBrowser	2023-09-24 16:28:32 +02:00
DominikDoom	2baa12fea3	Merge branch 'main' into feature-sort-by-frequent-use	2023-09-24 15:34:18 +02:00
DominikDoom	1a9157fe6e	Fix wildcard load if no non-extension wildcards exist Fixes #241	2023-09-21 10:15:53 +02:00
DominikDoom	67eeb5fbf6	Merge branch 'main' into feature-sort-by-frequent-use	2023-09-19 12:14:12 +02:00
DominikDoom	5911248ab9	Merge branch 'feature-sorting' into main Update including a new sorting option for extra network models & wildcards. For now only by date modified, this might be expanded in the future. A "sort by frequent use" is also in the works.	2023-09-19 12:13:01 +02:00
DominikDoom	1c693c0263	Catch UnicodeDecodeError to prevent corrupted yaml files from breaking the extension As mentioned in #240	2023-09-17 15:28:34 +02:00
DominikDoom	11ffed8afc	Merge branch 'feature-sorting' into feature-sort-by-frequent-use	2023-09-15 16:37:34 +02:00
DominikDoom	cb54b66eda	Refactor PR #239 to use new refresh API endpoint of this branch	2023-09-15 16:32:20 +02:00
DominikDoom	92a937ad01	Merge branch 'main' into feature-sorting	2023-09-15 16:30:23 +02:00
DominikDoom	ba9dce8d90	Merge pull request #239 from NoCrypt/add_extra_refresh_listener	2023-09-15 16:29:35 +02:00
NoCrypt	2622e1b596	Refresh extra: fix python code did not excecuted	2023-09-15 21:12:30 +07:00
NoCrypt	b03b1a0211	Add listener for extra network refresh button	2023-09-15 20:48:16 +07:00
DominikDoom	3e33169a3a	Disable sort order dropdown pointer events while refresh is running Doesn't prevent keyboard focus, but changing the values there is much slower since the list doesn't stay open.	2023-09-13 22:30:37 +02:00
DominikDoom	d8d991531a	Don't sort umi tags since they use count	2023-09-13 22:04:59 +02:00
DominikDoom	f626b9453d	Merge branch 'main' into feature-sorting	2023-09-13 21:56:29 +02:00
DominikDoom	5067afeee9	Add missing null safety	2023-09-13 21:55:09 +02:00
DominikDoom	018c6c8198	Fix Umi tag gathering & sorting Fixes #238	2023-09-13 21:50:41 +02:00
DominikDoom	2846d79b7d	Small cleanup, add reverse option Properly add text at the end on non-reverse numeric	2023-09-13 19:39:48 +02:00
DominikDoom	783a847978	Fix typo	2023-09-13 16:37:44 +02:00
DominikDoom	44effca702	Add sorting to javascript side Now uses the sortKey if available. Elements without a sortKey will always use name as fallback. Removed sort direction API again since it needs to be modeled case-by-case in the javascript anyway.	2023-09-13 14:03:49 +02:00
DominikDoom	475ef59197	Rework sorting function to calculate keys instead of pre-sort the list Rename added/changed variables to be clearer	2023-09-13 11:46:17 +02:00
Symbiomatrix	3953260485	Model sort selection.	2023-09-13 01:34:49 +03:00
DominikDoom	0a8e7d7d84	Stub API setup for tag usage stats	2023-09-12 14:10:15 +02:00
DominikDoom	46d07d703a	Improve parentheses handling Still not perfect, but hoüpefully a good compromise. Should be less annoying during normal prompt writing. Closes #107	2023-09-12 12:56:55 +02:00
DominikDoom	bd1dbe92c2	Don't trigger on programmatic third party input events Fixes #233	2023-09-12 11:50:07 +02:00
DominikDoom	66fa745d6f	Merge pull request #235 from hakaserver/main	2023-09-12 09:46:09 +02:00
hakaserver	37b5dca66e	lyco_path fix	2023-09-12 00:57:35 -03:00
DominikDoom	5db035cc3a	Add missing comma for keyword insertion at end	2023-09-09 14:54:11 +02:00
DominikDoom	90cf3147fd	Formatting	2023-09-09 14:51:24 +02:00
DominikDoom	4d4f23e551	Formatting	2023-09-09 14:43:55 +02:00
DominikDoom	80b47c61bb	Add new setting to choose where keywords get inserted Closes #232	2023-09-09 14:41:52 +02:00
DominikDoom	57821aae6a	Add option to include embeddings in normal search along with new keybind functionality for quick jumping between sections. Closes #230	2023-09-07 13:18:04 +02:00
DominikDoom	e23bb6d4ea	Add support for --wildcards-dir cmd argument Refactor PR #229 a bit to share code with this	2023-09-02 17:59:27 +02:00
DominikDoom	d4cca00575	Merge pull request #229 from azmodii/main	2023-09-02 17:27:00 +02:00
DominikDoom	86ea94a565	Merge pull request #228 from re-unknown/main	2023-09-02 17:08:13 +02:00
Joel Clark	53f46c91a2	feat: Allow support for custom wildcard directory in sd-dynamic-prompts	2023-09-02 21:30:01 +10:00
ReUnknown	e5f93188c3	Support for updated style editor	2023-09-02 16:51:41 +09:00
DominikDoom	3e57842ac6	Remove unnecessary autocomplete call in wildcards which would result in duplicate file requests	2023-08-29 10:23:13 +02:00
DominikDoom	32c4589df3	Rework wildcards to use own API endpoint Maybe fixes #226	2023-08-29 09:39:32 +02:00
DominikDoom	5bbd97588c	Remove duplicate slash from wildcard files (should be cosmetic only)	2023-08-28 19:15:34 +02:00
DominikDoom	b2a663f7a7	Merge pull request #223 from Symbiomatrix/embload	2023-08-20 19:08:40 +02:00
Symbiomatrix	6f93d19a2b	Edit error message.	2023-08-20 20:02:57 +03:00
Symbiomatrix	79bab04fd2	Typo.	2023-08-20 18:59:12 +03:00
Symbiomatrix	5b69d1e622	Embedding forced reload.	2023-08-20 18:51:37 +03:00
DominikDoom	651cf5fb46	Add metaKey and Shift to non-captured modifiers Fixes #222	2023-08-19 11:59:41 +02:00
DominikDoom	5deb72cddf	Add clearer README description for legacy translations As suggested in #221	2023-08-16 10:50:05 +02:00
DominikDoom	97ebe78205	!After Detailer (adetailer) support	2023-08-15 14:44:38 +02:00
DominikDoom	b937e853c9	Fix booru wiki links with translations	2023-08-08 19:23:13 +02:00
DominikDoom	f63bbf947f	Fix API endpoint to work with symlinks / external folders Fixes #217	2023-08-07 22:15:48 +02:00
DominikDoom	16bc6d8868	Update README.md	2023-08-07 19:48:27 +02:00
DominikDoom	ebe276ee44	Fix for lora filenames containing dots Since file extensions are already cut off before the client-side request, it's not needed here anymore	2023-08-07 19:22:50 +02:00
DominikDoom	995a5ecdba	Live preview images for extra networks Same as the thumbnails in the extra networks tab, just in a small preview window during completion	2023-08-07 18:50:55 +02:00
DominikDoom	90d144a5f4	Fix for new trimming rule cutting off first letter if Loras weren't in a subfolder	2023-08-07 17:51:21 +02:00
DominikDoom	14a4440c33	Fix extra network sorting Caused by loras including their (hidden) folder prefixes instead of just by name	2023-08-07 17:38:40 +02:00
DominikDoom	cdf092f3ac	Fix lora keyword lookup for deep subfolders	2023-08-07 15:17:49 +02:00
DominikDoom	e1598378dc	Merge pull request #215 from bluelovers/pr/model-keyword-001	2023-08-07 09:24:38 +02:00
bluelovers	599ad7f95f	fix: known_lora_hashes.txt https://github.com/DominikDoom/a1111-sd-webui-tagcomplete/issues/214 https://github.com/canisminor1990/sd-webui-lobe-theme/issues/324	2023-08-07 09:54:10 +08:00
DominikDoom	0b2bb138ee	Add option to keep wildcard file content order instead of sorting alphabetically Fixes #211	2023-08-05 13:42:24 +02:00
DominikDoom	4a415f1a04	Fix for duplicate wildcard entries Caused by multiple yaml files specifying the same subkey	2023-07-29 17:27:43 +02:00
DominikDoom	21de5fe003	Merge branch 'feature-fix-dynamic-prompt-yaml' into main Fixes #209	2023-07-29 16:30:19 +02:00
DominikDoom	a020df91b2	Fix wildcard traversal condition	2023-07-29 16:26:07 +02:00
DominikDoom	0260765b27	Add support for dynamic-prompts yaml wildcards	2023-07-29 16:13:23 +02:00