[PR #1] Github to OWUI data pipeline #5

Open
opened 2026-10-18 14:04:51 +00:00 by bsakaguchi · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/open-webui/cookbook/pull/1
Author: @danielrosehill
Created: 3/21/2025
Status: 🔄 Open

Base: main ← Head: recipe/github-knowledge-pipeline


📝 Commits (1)

  • b91625e Github to OWUI data pipeline

📊 Changes

13 files changed (+1200 additions, -0 deletions)

View changed files

➕ knowledge/github-to-owui-pipeline/README.md (+143 -0)
➕ knowledge/github-to-owui-pipeline/code/create_config.py (+38 -0)
➕ knowledge/github-to-owui-pipeline/code/src/owui_api.py (+503 -0)
➕ knowledge/github-to-owui-pipeline/code/src/sync_knowledge.py (+293 -0)
➕ knowledge/github-to-owui-pipeline/code/src/utils/file_utils.py (+64 -0)
➕ knowledge/github-to-owui-pipeline/config.template.json (+7 -0)
➕ knowledge/github-to-owui-pipeline/context-data/README.md (+50 -0)
➕ knowledge/github-to-owui-pipeline/context-data/sample-collection/example.md (+20 -0)
➕ knowledge/github-to-owui-pipeline/context-data/sample-collection/test_file.txt (+5 -0)
➕ knowledge/github-to-owui-pipeline/diagrams/auth.png (+0 -0)
➕ knowledge/github-to-owui-pipeline/diagrams/embedding.png (+0 -0)
➕ knowledge/github-to-owui-pipeline/tests/test_file.txt (+4 -0)
➕ knowledge/github-to-owui-pipeline/tests/test_upload.py (+73 -0)

📄 Description

This pull request adds a new recipe that demonstrates how to create an automated pipeline for syncing content from a GitHub repository to OpenWebUI knowledge collections.

Features:

  • Automated content synchronization from GitHub to OpenWebUI
  • Directory-based organization that maps to knowledge collections
  • Support for Cloudflare authentication
  • Comprehensive documentation and code samples
  • Includes configuration templates and test examples

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/cookbook/pull/1 **Author:** [@danielrosehill](https://github.com/danielrosehill) **Created:** 3/21/2025 **Status:** 🔄 Open **Base:** `main` ← **Head:** `recipe/github-knowledge-pipeline` --- ### 📝 Commits (1) - [`b91625e`](https://github.com/open-webui/cookbook/commit/b91625ef8764db5e0c0e0d04a551360950515b1b) Github to OWUI data pipeline ### 📊 Changes **13 files changed** (+1200 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `knowledge/github-to-owui-pipeline/README.md` (+143 -0) ➕ `knowledge/github-to-owui-pipeline/code/create_config.py` (+38 -0) ➕ `knowledge/github-to-owui-pipeline/code/src/owui_api.py` (+503 -0) ➕ `knowledge/github-to-owui-pipeline/code/src/sync_knowledge.py` (+293 -0) ➕ `knowledge/github-to-owui-pipeline/code/src/utils/file_utils.py` (+64 -0) ➕ `knowledge/github-to-owui-pipeline/config.template.json` (+7 -0) ➕ `knowledge/github-to-owui-pipeline/context-data/README.md` (+50 -0) ➕ `knowledge/github-to-owui-pipeline/context-data/sample-collection/example.md` (+20 -0) ➕ `knowledge/github-to-owui-pipeline/context-data/sample-collection/test_file.txt` (+5 -0) ➕ `knowledge/github-to-owui-pipeline/diagrams/auth.png` (+0 -0) ➕ `knowledge/github-to-owui-pipeline/diagrams/embedding.png` (+0 -0) ➕ `knowledge/github-to-owui-pipeline/tests/test_file.txt` (+4 -0) ➕ `knowledge/github-to-owui-pipeline/tests/test_upload.py` (+73 -0) </details> ### 📄 Description This pull request adds a new recipe that demonstrates how to create an automated pipeline for syncing content from a GitHub repository to OpenWebUI knowledge collections. **Features:** - Automated content synchronization from GitHub to OpenWebUI - Directory-based organization that maps to knowledge collections - Support for Cloudflare authentication - Comprehensive documentation and code samples - Includes configuration templates and test examples --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
open-webui/cookbook#5
No description provided.