[PR #265] Add CUDA 13.3 and 13.4 variant support to Inference Runtime settings #236

New issue

Open

opened 2026-10-18 14:07:13 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-18 14:07:13 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/open-webui/desktop/pull/265
Author: @kulbhushanchand
Created: 8/28/2026
Status: 🔄 Open

Base: main ← Head: main

📝 Commits (5)

b2d7222 Add support for CUDA 13.3 and 13.4 variants
0bd99f7 Add CUDA 13.3 and 13.4 options to InferenceRuntime
1df856f Merge pull request #2 from kulbhushanchand/patch-1
baf0fc4 Merge pull request #1 from kulbhushanchand/patch-2
a61d553 Potential fix for pull request finding

📊 Changes

2 files changed (+4 additions, -0 deletions)

View changed files

📝 src/main/utils/llamacpp.ts (+2 -0)
📝 src/renderer/src/lib/components/Main/Settings/InferenceRuntime.svelte (+2 -0)

📄 Description

Description

The Inference Runtime settings only offered CUDA 12.4 and CUDA 13.1 as
llama.cpp variants. Recent llama.cpp releases (e.g. b10666) ship CUDA 13.3
and 13.4 Windows builds, so users on newer GPUs/drivers had no way to select
them and would fall back to CPU-only inference.

This PR adds cuda-13.3 and cuda-13.4 as additional pinned variant
options, alongside the existing cuda-12.4 and cuda-13.1 — same pattern,
same exact-match asset resolution already used in getAssetPattern().
Nothing existing was changed or removed, so pinning an older release tag
(via the Release Version field) that only shipped cuda-13.1 still resolves
correctly.

Fixes #264

Contributor License Agreement

By submitting this pull request, I confirm that I have read and fully agree to the Contributor License Agreement (CLA), and I am providing my contributions under its terms.

Note

Deleting the CLA section will lead to immediate closure of your PR and it will not be merged in.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/desktop/pull/265 **Author:** [@kulbhushanchand](https://github.com/kulbhushanchand) **Created:** 8/28/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (5) - [`b2d7222`](https://github.com/open-webui/desktop/commit/b2d72221c2a1f82ae0e225368e78c59166004c20) Add support for CUDA 13.3 and 13.4 variants - [`0bd99f7`](https://github.com/open-webui/desktop/commit/0bd99f78fbc2624dccff3545e1b8eef265102aa3) Add CUDA 13.3 and 13.4 options to InferenceRuntime - [`1df856f`](https://github.com/open-webui/desktop/commit/1df856f020835c6bcf24a9152e5a7127258e571e) Merge pull request #2 from kulbhushanchand/patch-1 - [`baf0fc4`](https://github.com/open-webui/desktop/commit/baf0fc4ad64d3383c15c8028e8bb2a75330c62bd) Merge pull request #1 from kulbhushanchand/patch-2 - [`a61d553`](https://github.com/open-webui/desktop/commit/a61d553762be375ef8e491d5fd9f3c963c88e391) Potential fix for pull request finding ### 📊 Changes **2 files changed** (+4 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `src/main/utils/llamacpp.ts` (+2 -0) 📝 `src/renderer/src/lib/components/Main/Settings/InferenceRuntime.svelte` (+2 -0) </details> ### 📄 Description ## Description The Inference Runtime settings only offered CUDA 12.4 and CUDA 13.1 as llama.cpp variants. Recent llama.cpp releases (e.g. b10666) ship CUDA 13.3 and 13.4 Windows builds, so users on newer GPUs/drivers had no way to select them and would fall back to CPU-only inference. This PR adds `cuda-13.3` and `cuda-13.4` as additional pinned variant options, alongside the existing `cuda-12.4` and `cuda-13.1` — same pattern, same exact-match asset resolution already used in `getAssetPattern()`. Nothing existing was changed or removed, so pinning an older release tag (via the Release Version field) that only shipped `cuda-13.1` still resolves correctly. ## Related Issues Fixes #264 --- ## Contributor License Agreement  - [x] By submitting this pull request, I confirm that I have read and fully agree to the [Contributor License Agreement (CLA)](https://github.com/open-webui/desktop/blob/main/CONTRIBUTOR_LICENSE_AGREEMENT), and I am providing my contributions under its terms. > [!NOTE] > Deleting the CLA section will lead to immediate closure of your PR and it will not be merged in. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi added the

pull-request

label

2026-10-18 14:07:13 +00:00

No labels

help wanted

pull-request

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

open-webui/desktop#236

No description provided.

Rows
Columns