mirror of
https://github.com/open-webui/pipelines.git
synced 2026-11-05 01:37:24 +00:00
[GH-ISSUE #9] feat: RAG hooks (e.g. upload_document) #13
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
open-webui/pipelines#13
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @tjbck on GitHub (May 25, 2024).
Original GitHub issue: https://github.com/open-webui/pipelines/issues/9
pipelines should have all the hooks required for enable custom end-to-end RAG for open-webui
@MarlNox commented on GitHub (May 31, 2024):
Reposting for discussion purposes:
What would be the suggested approach to query the documents that OpenWebUI already has in memory? Currently, I'm "copying" the approach from the Apps/RAG section of the web UI, but it feels quite heavy (had to transplant lot of files/modules to pipelines to make it work), and fails to fetch collections by names, unless i put the hashed name in the search.
What would be a better way to conduct rag on the current documents we have on openwebui?
@tjbck commented on GitHub (May 31, 2024):
That's a use case I haven't deeply thought about yet, but you should be able to use open webui API to do basic retrieval tasks. (check
[open-webui url]/rag/api/v1/docs)Could elaborate more on how you'd like to utilise pipelines and I'll make the appropriate changes if needed!
@MarlNox commented on GitHub (Jun 1, 2024):
Yep, Im currently working on making the pipeline i described in the enhancement.
Basically the user asks a question, the system comes back with a response of sorts:
"Here are a list of 5 documents which are the most relevant to your query: [list of docs]"
The user chooses document 1 and 3 by communicating it to the agent (or maybe even through some sort of GUI interaction).
Any further interactions with the agent will be search queries on the documents selected.
This would mean that the first query is used to run a search through the whole documents database.
Then a few lines of communication will be used to steer the subsequent interactions based on user choice.