[GH-ISSUE #9] feat: RAG hooks (e.g. upload_document) #13

Open
opened 2026-10-18 21:01:31 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @tjbck on GitHub (May 25, 2024).
Original GitHub issue: https://github.com/open-webui/pipelines/issues/9

pipelines should have all the hooks required for enable custom end-to-end RAG for open-webui

Originally created by @tjbck on GitHub (May 25, 2024). Original GitHub issue: https://github.com/open-webui/pipelines/issues/9 pipelines should have all the hooks required for enable custom end-to-end RAG for open-webui
Author
Owner

@MarlNox commented on GitHub (May 31, 2024):

Reposting for discussion purposes:

What would be the suggested approach to query the documents that OpenWebUI already has in memory? Currently, I'm "copying" the approach from the Apps/RAG section of the web UI, but it feels quite heavy (had to transplant lot of files/modules to pipelines to make it work), and fails to fetch collections by names, unless i put the hashed name in the search.

What would be a better way to conduct rag on the current documents we have on openwebui?

<!-- gh-comment-id:2141520172 --> @MarlNox commented on GitHub (May 31, 2024): Reposting for discussion purposes: What would be the suggested approach to query the documents that OpenWebUI already has in memory? Currently, I'm "copying" the approach from the Apps/RAG section of the web UI, but it feels quite heavy (had to transplant lot of files/modules to pipelines to make it work), and fails to fetch collections by names, unless i put the hashed name in the search. What would be a better way to conduct rag on the current documents we have on openwebui?
Author
Owner

@tjbck commented on GitHub (May 31, 2024):

That's a use case I haven't deeply thought about yet, but you should be able to use open webui API to do basic retrieval tasks. (check [open-webui url]/rag/api/v1/docs)

Could elaborate more on how you'd like to utilise pipelines and I'll make the appropriate changes if needed!

<!-- gh-comment-id:2142996519 --> @tjbck commented on GitHub (May 31, 2024): That's a use case I haven't deeply thought about yet, but you should be able to use open webui API to do basic retrieval tasks. (check `[open-webui url]/rag/api/v1/docs`) Could elaborate more on how you'd like to utilise pipelines and I'll make the appropriate changes if needed!
Author
Owner

@MarlNox commented on GitHub (Jun 1, 2024):

That's a use case I haven't deeply thought about yet, but you should be able to use open webui API to do basic retrieval tasks. (check [open-webui url]/rag/api/v1/docs)

Could elaborate more on how you'd like to utilise pipelines and I'll make the appropriate changes if needed!

Yep, Im currently working on making the pipeline i described in the enhancement.
Basically the user asks a question, the system comes back with a response of sorts:
"Here are a list of 5 documents which are the most relevant to your query: [list of docs]"
The user chooses document 1 and 3 by communicating it to the agent (or maybe even through some sort of GUI interaction).
Any further interactions with the agent will be search queries on the documents selected.

This would mean that the first query is used to run a search through the whole documents database.
Then a few lines of communication will be used to steer the subsequent interactions based on user choice.

<!-- gh-comment-id:2143619293 --> @MarlNox commented on GitHub (Jun 1, 2024): > That's a use case I haven't deeply thought about yet, but you should be able to use open webui API to do basic retrieval tasks. (check `[open-webui url]/rag/api/v1/docs`) > > Could elaborate more on how you'd like to utilise pipelines and I'll make the appropriate changes if needed! Yep, Im currently working on making the pipeline i described in the enhancement. Basically the user asks a question, the system comes back with a response of sorts: "Here are a list of 5 documents which are the most relevant to your query: [list of docs]" The user chooses document 1 and 3 by communicating it to the agent (or maybe even through some sort of GUI interaction). Any further interactions with the agent will be search queries on the documents selected. This would mean that the first query is used to run a search through the whole documents database. Then a few lines of communication will be used to steer the subsequent interactions based on user choice.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
open-webui/pipelines#13
No description provided.