[PR #66] [MERGED] koboldcpp quickstart guide #72

New issue

Closed

opened 2026-10-15 18:01:32 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-15 18:01:32 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/SillyTavern/SillyTavern-Docs/pull/66
Author: @boomersama
Created: 2/19/2024
Status: ✅ Merged
Merged: 2/24/2024
Merged by: @Cohee1207

Base: main ← Head: main

📝 Commits (6)

bb895a4 Create koboldcpp.md
9416747 edit koboldcpp.md
ac6c86e update model size calculator link & "a llm" -> "an llm"
7b0c67a Oobagooba -> Oobabooga
d3773d7 QuantMatMul clarification
03bb409 attributions

📊 Changes

2 files changed (+81 additions, -25 deletions)

View changed files

➕ Usage/API Connections/koboldcpp.md (+69 -0)
📝 Usage/Local LLM Guide/How To Use A Self-Hosted Model.md (+12 -25)

📄 Description

what it does

adds a quickstart guide for KoboldCPP on Windows/Nvidia
updates an obsolete link in How To Use A Self-Hosted Model.md
fixes a few grammar/spelling issues

what it doesn't

cover full CPU offloading/AMD ROCM setup (yet)
fix all grammar/spelling issues

I'm planning to write a quickstart guide for every local API, so let me know if you would like for things to be done differently.

:pensivecowboy:

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/SillyTavern/SillyTavern-Docs/pull/66 **Author:** [@boomersama](https://github.com/boomersama) **Created:** 2/19/2024 **Status:** ✅ Merged **Merged:** 2/24/2024 **Merged by:** [@Cohee1207](https://github.com/Cohee1207) **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (6) - [`bb895a4`](https://github.com/SillyTavern/SillyTavern-Docs/commit/bb895a468822e1ef87079fe324f686d2a8a4c855) Create koboldcpp.md - [`9416747`](https://github.com/SillyTavern/SillyTavern-Docs/commit/941674727e32cd7eb996352db96630ef19d3b12a) edit koboldcpp.md - [`ac6c86e`](https://github.com/SillyTavern/SillyTavern-Docs/commit/ac6c86e3f2d0ea5f835d3ad52562fc9903781742) update model size calculator link & "a llm" -> "an llm" - [`7b0c67a`](https://github.com/SillyTavern/SillyTavern-Docs/commit/7b0c67a4955b84a4b905a657eddca4b3931b0c9b) Oobagooba -> Oobabooga - [`d3773d7`](https://github.com/SillyTavern/SillyTavern-Docs/commit/d3773d728be81658aa1d6969617343f915e6ae8a) QuantMatMul clarification - [`03bb409`](https://github.com/SillyTavern/SillyTavern-Docs/commit/03bb40905eb92820526b16616610cb8309de732c) attributions ### 📊 Changes **2 files changed** (+81 additions, -25 deletions) <details> <summary>View changed files</summary> ➕ `Usage/API Connections/koboldcpp.md` (+69 -0) 📝 `Usage/Local LLM Guide/How To Use A Self-Hosted Model.md` (+12 -25) </details> ### 📄 Description what it does * adds a quickstart guide for KoboldCPP on Windows/Nvidia * updates an obsolete link in `How To Use A Self-Hosted Model.md` * fixes a few grammar/spelling issues what it doesn't * cover full CPU offloading/AMD ROCM setup (yet) * fix all grammar/spelling issues I'm planning to write a quickstart guide for every local API, so let me know if you would like for things to be done differently. :pensivecowboy: --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-15 18:01:32 +00:00