mirror of
https://github.com/theroyallab/tabbyAPI.git
synced 2026-03-14 15:57:27 +00:00
There is no platform agnostic way to fetch CUDA/ROCm's versions since environment variables change and users don't necessarily need CUDA or ROCm installed to run pytorch (pytorch installs the necessary libs if they don't exist). Therefore, prompt the user for their GPU lib and store the result in a textfile so the user doesn't need to constantly enter a preference. Signed-off-by: kingbri <bdashore3@proton.me>
4.2 KiB
4.2 KiB