[GH-ISSUE #65] [Feature request] Specify which GPU to use if CUDA is selected as a command line argument. #46

New issue

Closed

opened 2026-10-15 18:03:44 +00:00 by bsakaguchi · 1 comment

bsakaguchi commented

2026-10-15 18:03:44 +00:00

Owner

Originally created by @Amajiro on GitHub (Jun 26, 2023).
Original GitHub issue: https://github.com/SillyTavern/SillyTavern-Extras/issues/65

I have two graphics cards and do my sillytavern-extras processing on the second one. Could we have a command line argument (maybe as a condition to --CUDA) to specify which GPU to use? Otherwise I have to edit device_string = "cuda:0" every time there's an update.

Originally created by @Amajiro on GitHub (Jun 26, 2023). Original GitHub issue: https://github.com/SillyTavern/SillyTavern-Extras/issues/65 I have two graphics cards and do my sillytavern-extras processing on the second one. Could we have a command line argument (maybe as a condition to --CUDA) to specify which GPU to use? Otherwise I have to edit `device_string = "cuda:0"` every time there's an update.

bsakaguchi closed this issue

2026-10-15 18:03:44 +00:00

bsakaguchi commented

2026-10-15 18:03:45 +00:00

Author

Owner

@Cohee1207 commented on GitHub (Jun 26, 2023):

Added --cuda-device command line option. Defaults to cuda:0 as previously stated. Also, keep in mind that not every transformers module supports running in multi-GPU mode.

@Cohee1207 commented on GitHub (Jun 26, 2023): Added `--cuda-device` command line option. Defaults to `cuda:0` as previously stated. Also, keep in mind that not every transformers module supports running in multi-GPU mode.