mirror of
https://github.com/open-webui/docs.git
synced 2026-11-05 01:38:13 +00:00
[PR #89] [MERGED] Add tutorial: Local LLM Setup with IPEX-LLM on Intel GPU #237
Labels
No labels
bug
documentation
documentation
duplicate
enhancement
enhancement
good first issue
good first issue
good first issue
help wanted
help wanted
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
open-webui/docs#237
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/open-webui/docs/pull/89
Author: @Oscilloscope98
Created: 6/3/2024
Status: ✅ Merged
Merged: 6/3/2024
Merged by: @tjbck
Base:
main← Head:ipex-llm📝 Commits (5)
b637d41Add tutorial draft: Local LLM Setup with IPEX-LLM on Intel GPU0b0c908Update for configuration04ef5b5typo fix3bc10aaMerge pull request #2 from Oscilloscope98/ipex-llm-tutorialb4191d9Small typo fixes📊 Changes
1 file changed (+38 additions, -0 deletions)
View changed files
➕
docs/tutorial/ipex_llm.md(+38 -0)📄 Description
IPEX-LLM is a PyTorch library for running LLM on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc A-Series, Flex and Max) with very low latency.
This tutorial demonstrates how to setup Open WebUI with IPEX-LLM accelerated Ollama backend hosted on Intel GPU. By following this guide, you will be able to setup Open WebUI even on a low-cost PC (i.e. only with integrated GPU) with a smooth experience.
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.