mirror of
https://github.com/SillyTavern/SillyTavern-Docs.git
synced 2026-10-16 02:11:54 +00:00
[PR #95] [MERGED] Added instructions for Docker users for linking self-hosted LLMs #101
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
SillyTavern/SillyTavern-Docs#101
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/SillyTavern/SillyTavern-Docs/pull/95
Author: @aaronshenhao
Created: 8/30/2024
Status: ✅ Merged
Merged: 8/30/2024
Merged by: @Cohee1207
Base:
main← Head:patch-2📝 Commits (1)
9629c91Added instructions for Docker users.📊 Changes
1 file changed (+4 additions, -0 deletions)
View changed files
📝
Usage/Local LLM Guide/How To Use A Self-Hosted Model.md(+4 -0)📄 Description
I was experimenting with SillyTavern on Docker and couldn't get it to work with LMStudio's OpenAI compatible endpoint. Apparently, SillyTavern accesses the API from the server's end, which means that users have to use
http://host.docker.internal:<port>instead ofhttp://127.0.0.1:<port>. This difference is very subtle, and is likely to be overlooked by beginners or those unfamiliar with Docker. I've updated the documentation to point this out.🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.