[GH-ISSUE #190] Issue with Chromabd and vectorization. #114

New issue

Closed

opened 2026-10-15 18:04:34 +00:00 by bsakaguchi · 3 comments

bsakaguchi commented

2026-10-15 18:04:34 +00:00

Owner

Originally created by @Theking1313 on GitHub (Nov 22, 2023).
Original GitHub issue: https://github.com/SillyTavern/SillyTavern-Extras/issues/190

I tried using the chromadb feature and it seems to have installed correctly but it does not work, even when I press the Vectorize All button. I'm using default settings but am using gpu for extras.

Vectorization failed
Check server console for more details

Streaming request finished
SyntaxError: Unexpected end of JSON input
    at JSON.parse (<anonymous>)
    at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31)
    at Generator.next (<anonymous>)
    at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58)
SyntaxError: Unexpected end of JSON input
    at JSON.parse (<anonymous>)
    at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31)
    at Generator.next (<anonymous>)
    at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58)
SyntaxError: Unexpected end of JSON input
    at JSON.parse (<anonymous>)
    at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31)
    at Generator.next (<anonymous>)
    at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58)
SyntaxError: Unexpected end of JSON input
    at JSON.parse (<anonymous>)
    at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31)
    at Generator.next (<anonymous>)
    at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58)

Originally created by @Theking1313 on GitHub (Nov 22, 2023). Original GitHub issue: https://github.com/SillyTavern/SillyTavern-Extras/issues/190 I tried using the chromadb feature and it seems to have installed correctly but it does not work, even when I press the Vectorize All button. I'm using default settings but am using gpu for extras. Vectorization failed Check server console for more details ```cmd Streaming request finished SyntaxError: Unexpected end of JSON input at JSON.parse (<anonymous>) at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31) at Generator.next (<anonymous>) at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58) SyntaxError: Unexpected end of JSON input at JSON.parse (<anonymous>) at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31) at Generator.next (<anonymous>) at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58) SyntaxError: Unexpected end of JSON input at JSON.parse (<anonymous>) at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31) at Generator.next (<anonymous>) at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58) SyntaxError: Unexpected end of JSON input at JSON.parse (<anonymous>) at LocalIndex.<anonymous> (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:337:31) at Generator.next (<anonymous>) at fulfilled (C:\New folder (2)\SillyTavern-1.10.8\node_modules\vectra\lib\LocalIndex.js:28:58) ``` ![image](https://github.com/SillyTavern/SillyTavern-Extras/assets/57227697/450652dc-08be-4e3c-b65e-10c788f84d1d)

bsakaguchi closed this issue

2026-10-15 18:04:34 +00:00

bsakaguchi commented

2026-10-15 18:04:35 +00:00

Author

Owner

@Cohee1207 commented on GitHub (Nov 22, 2023):

Delete the vectors folder for your chat in the ST directory and regenerate them in the plugin settings.

@Cohee1207 commented on GitHub (Nov 22, 2023): Delete the vectors folder for your chat in the ST directory and regenerate them in the plugin settings.

bsakaguchi commented

2026-10-15 18:04:35 +00:00

Author

Owner

@Theking1313 commented on GitHub (Nov 22, 2023):

Thanks that worked.

I deleted the Vector folder and how see the processed number go up.

I will now how to test using the database and see it in action on a new chat.

@Theking1313 commented on GitHub (Nov 22, 2023): Thanks that worked. I deleted the Vector folder and how see the processed number go up. I will now how to test using the database and see it in action on a new chat.

bsakaguchi commented

2026-10-15 18:04:35 +00:00

Author

Owner

@Technologicat commented on GitHub (Feb 7, 2024):

Note that the Smart Context extension has now been superseded by the built-in Vector Storage extension.

Upgrading is recommended, as the old Smart Context extension is no longer developed.

Vector Storage does not need ChromaDB.

To upgrade:

Make sure both your SillyTavern and your ST-extras are up to date.
Configure your ST-extras server to load the embeddings module.
- Optionally, you can choose a custom text embedding model just as before, using the --embedding-model command-line argument of the ST-extras server.
- The embeddings module uses the device (CPU or GPU) that you have configured your ST-extras to use. As usual, see the --cpu (CPU, default), --cuda (GPU) and --cuda-device command-line arguments.
- The chromadb module in ST-extras, and the chromadb Python library, are no longer needed.
Restart your ST-extras server.
Restart SillyTavern, just to be safe.
In the ST GUI: Extensions ⊳ Vector Storage ⊳ Vectorization Source: choose Extras
Done! You should now have Vector Storage working with the fast Extras provider.

@Technologicat commented on GitHub (Feb 7, 2024): Note that the *Smart Context* extension has now been superseded by the built-in *Vector Storage* extension. Upgrading is recommended, as the old *Smart Context* extension is no longer developed. *Vector Storage* does not need ChromaDB. To upgrade: - Make sure both your SillyTavern and your ST-extras are up to date. - Configure your ST-extras server to load the `embeddings` module. - Optionally, you can choose a custom text embedding model just as before, using the `--embedding-model` command-line argument of the ST-extras server. - The `embeddings` module uses the device (CPU or GPU) that you have configured your ST-extras to use. As usual, see the `--cpu` (CPU, default), `--cuda` (GPU) and `--cuda-device` command-line arguments. - The `chromadb` module in ST-extras, and the `chromadb` Python library, are no longer needed. - Restart your ST-extras server. - Restart SillyTavern, just to be safe. - In the ST GUI: *Extensions ⊳ Vector Storage ⊳ Vectorization Source*: choose *Extras* - Done! You should now have *Vector Storage* working with the fast *Extras* provider.