[GH-ISSUE #371] [Documentation] Inference Platform Support #56

New issue

Closed

opened 2026-10-18 14:08:33 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-18 14:08:33 +00:00

Owner

Originally created by @Siddhesh-Agarwal on GitHub (Jan 28, 2025).
Original GitHub issue: https://github.com/open-webui/docs/issues/371

It would be a good idea to add information about how to integrate inference platforms such as Groq, TogetherAI and DeepSeek in the docs. To integrate the above the procedure is:

Admin Panel -> Settings -> Connections -> Manage OpenAI API Connections -> Add Connection

Fill in the Base URL and API Key

The base URLs for the above providers are:

Originally created by @Siddhesh-Agarwal on GitHub (Jan 28, 2025). Original GitHub issue: https://github.com/open-webui/docs/issues/371 It would be a good idea to add information about how to integrate inference platforms such as [Groq](https://groq.com/), [TogetherAI](https://www.together.ai/) and [DeepSeek](https://www.deepseek.com/) in the docs. To integrate the above the procedure is: `Admin Panel` -> `Settings` -> `Connections` -> `Manage OpenAI API Connections` -> `Add Connection` Fill in the Base URL and API Key The base URLs for the above providers are: - Groq: https://api.groq.com/openai/v1 - TogetherAI: https://api.together.xyz/v1 - DeepSeek: https://api.deepseek.com/v1

bsakaguchi

2026-10-18 14:08:33 +00:00

closed this issue
added the
documentation
label

bsakaguchi commented

2026-10-18 14:08:34 +00:00

Author

Owner

@Classic298 commented on GitHub (Sep 14, 2025):

Hi, I think some improvements were made in the last weeks, which mention LiteLLM and OpenRouter as inference platforms, since both can act as a BYOK platforms - is there a need to add even more references?

In essence, the documentation already states that every platform with an OpenAI compatible endpoint should be supported.

@Classic298 commented on GitHub (Sep 14, 2025): Hi, I think some improvements were made in the last weeks, which mention LiteLLM and OpenRouter as inference platforms, since both can act as a BYOK platforms - is there a need to add even more references? In essence, the documentation already states that every platform with an OpenAI compatible endpoint should be supported.

bsakaguchi commented

2026-10-18 14:08:34 +00:00

Author

Owner

@Siddhesh-Agarwal commented on GitHub (Sep 14, 2025):

Hey! So when I created the PR, BYOK docs were not very clear. I figured out how to configure but then forgot to close this Issue. Sorry for the trouble I caused! Have a great day!

@Siddhesh-Agarwal commented on GitHub (Sep 14, 2025): Hey! So when I created the PR, BYOK docs were not very clear. I figured out how to configure but then forgot to close this Issue. Sorry for the trouble I caused! Have a great day!

bsakaguchi referenced this issue

2026-10-18 14:10:13 +00:00

[PR #56] [MERGED] Added YouTube tutorial to tutorial-deployments/index.md #210