[GH-ISSUE #243] GPU Selection #150

New issue

Closed

opened 2026-10-15 18:05:02 +00:00 by bsakaguchi · 1 comment

bsakaguchi commented

2026-10-15 18:05:02 +00:00

Owner

Originally created by @tyrael0315 on GitHub (Jun 1, 2024).
Original GitHub issue: https://github.com/SillyTavern/SillyTavern-Extras/issues/243

Hello. I have a problem. For the life of me, I can't select the GPU I want to load the Silly Tavern Extras server. I have two GPUs installed one 4060ti 16GB (cuda:0) and one 1080ti 11 GB (cuda:1). I used the --cuda-device argument with 'x', "x", x,=x with all the previous variants, it always switches back to cpu. And yes, --cuda argument works fine, it find the 4060ti (cuda:0) and loads on it normally, but I want to load it on the 1080ti (cuda:1). Is there a syntax error on my side? Is there any special way to write this --cuda-device argument with its parameter?

Specs:
OS Windows 11
CPU i7-8700k
RAM 32GB
GPU 1 4060ti 16GB (cuda:0)
GPU 2 1080ti 11 GB (cuda:1)

Thank you in advance!

Originally created by @tyrael0315 on GitHub (Jun 1, 2024). Original GitHub issue: https://github.com/SillyTavern/SillyTavern-Extras/issues/243 Hello. I have a problem. For the life of me, I can't select the GPU I want to load the Silly Tavern Extras server. I have two GPUs installed one 4060ti 16GB (cuda:0) and one 1080ti 11 GB (cuda:1). I used the --cuda-device argument with 'x', "x", x,=x with all the previous variants, it always switches back to cpu. And yes, --cuda argument works fine, it find the 4060ti (cuda:0) and loads on it normally, but I want to load it on the 1080ti (cuda:1). Is there a syntax error on my side? Is there any special way to write this --cuda-device argument with its parameter? Specs: OS Windows 11 CPU i7-8700k RAM 32GB GPU 1 4060ti 16GB (cuda:0) GPU 2 1080ti 11 GB (cuda:1) Thank you in advance!

bsakaguchi closed this issue

2026-10-15 18:05:02 +00:00

bsakaguchi commented

2026-10-15 18:05:03 +00:00

Author

Owner

@tyrael0315 commented on GitHub (Jun 1, 2024):

On further testing, to be able to select the GPU you wish to use, the command line needs the argument "--cuda", followed by "--cuda-device cuda:x" (where x stands for the GPU that you wish to select 0,1, etc.)

@tyrael0315 commented on GitHub (Jun 1, 2024): On further testing, to be able to select the GPU you wish to use, the command line needs the argument "--cuda", followed by "--cuda-device cuda:x" (where x stands for the GPU that you wish to select 0,1, etc.)