[GH-ISSUE #71] [question/bug?] Do chromaDB module can work on CPU? #51

New issue

Closed

opened 2026-10-15 18:03:46 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-15 18:03:46 +00:00

Owner

Originally created by @valden80 on GitHub (Jul 1, 2023).
Original GitHub issue: https://github.com/SillyTavern/SillyTavern-Extras/issues/71

When I starting extras with this command line:
python server.py --cpu --enable-modules=caption,summarize,classify,chromadb
it still using GPU. (For chromaDB only, other modules use CPU.)

This is intended behavior or bug? I already read help files to find info about this, but don't get any answer from them...

Originally created by @valden80 on GitHub (Jul 1, 2023). Original GitHub issue: https://github.com/SillyTavern/SillyTavern-Extras/issues/71 When I starting extras with this command line: ``python server.py --cpu --enable-modules=caption,summarize,classify,chromadb`` it still using GPU. (For chromaDB only, other modules use CPU.) This is intended behavior or bug? I already read help files to find info about this, but don't get any answer from them...

bsakaguchi closed this issue

2026-10-15 18:03:46 +00:00

bsakaguchi commented

2026-10-15 18:03:47 +00:00

Author

Owner

@virt-10 commented on GitHub (Jul 23, 2023):

run one of the commands below before starting the sever with --cpu

for linux
export CUDA_VISIBLE_DEVICES=""

for windows cmd
set CUDA_VISIBLE_DEVICES=""

for windows powershell
$env:CUDA_VISIBLE_DEVICES=""

this is my bash script for linux

#!/usr/bin/bash

# activates conda env
eval "$(conda shell.bash hook)"
conda activate extras

# tells pytorch that we do not have a gpu
export CUDA_VISIBLE_DEVICES=""

# run server on cpu
python server.py --enable-modules=summarize,classify,silero-tts,chromadb,caption --listen --cpu

@virt-10 commented on GitHub (Jul 23, 2023): run one of the commands below before starting the sever with --cpu for linux `export CUDA_VISIBLE_DEVICES=""` for windows cmd `set CUDA_VISIBLE_DEVICES=""` for windows powershell `$env:CUDA_VISIBLE_DEVICES=""` this is my bash script for linux ``` #!/usr/bin/bash # activates conda env eval "$(conda shell.bash hook)" conda activate extras # tells pytorch that we do not have a gpu export CUDA_VISIBLE_DEVICES="" # run server on cpu python server.py --enable-modules=summarize,classify,silero-tts,chromadb,caption --listen --cpu ```

bsakaguchi commented

2026-10-15 18:03:47 +00:00

Author

Owner

@Cohee1207 commented on GitHub (Jul 31, 2023):

There were updates to make chroma respect --cpu flag. Update and check, please

@Cohee1207 commented on GitHub (Jul 31, 2023): There were updates to make chroma respect --cpu flag. Update and check, please

bsakaguchi referenced this issue

2026-10-15 18:03:47 +00:00

[GH-ISSUE #79] GET 401 - Unauthorized API key access. #53