[PR #58] web-connector: Added comprehensive logging and HTTP‑client centralization. #93

Open
opened 2026-10-18 21:14:19 +00:00 by bsakaguchi · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/open-webui/oikb/pull/58
Author: @Fearodin-LOS
Created: 6/18/2026
Status: 🔄 Open

Base: main ← Head: web-connector-logging


📝 Commits (1)

  • 529c4f3 web-connector: Added comprehensive logging and HTTP‑client centralization.

📊 Changes

7 files changed (+161 additions, -12 deletions)

View changed files

📝 .gitignore (+4 -0)
📝 docs/guide.md (+5 -0)
📝 src/oikb/cli.py (+4 -2)
📝 src/oikb/client.py (+3 -1)
📝 src/oikb/connectors/web.py (+82 -8)
📝 src/oikb/daemon.py (+2 -1)
➕ src/oikb/http.py (+61 -0)

📄 Description

Introduces detailed debug and info logs for sitemap parsing, link crawling, and page processing. Centralizes HTTP‑client creation via make_http_client() with OIKB_INSECURE_SSL support for self‑signed certificates. Extends the daemon with a --log‑level parameter for granular log control.
For testability reasons, it is currently implemented only for the web‑connector.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/oikb/pull/58 **Author:** [@Fearodin-LOS](https://github.com/Fearodin-LOS) **Created:** 6/18/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `web-connector-logging` --- ### 📝 Commits (1) - [`529c4f3`](https://github.com/open-webui/oikb/commit/529c4f3107489d6dfd909d33199d9c737d1f1b56) web-connector: Added comprehensive logging and HTTP‑client centralization. ### 📊 Changes **7 files changed** (+161 additions, -12 deletions) <details> <summary>View changed files</summary> 📝 `.gitignore` (+4 -0) 📝 `docs/guide.md` (+5 -0) 📝 `src/oikb/cli.py` (+4 -2) 📝 `src/oikb/client.py` (+3 -1) 📝 `src/oikb/connectors/web.py` (+82 -8) 📝 `src/oikb/daemon.py` (+2 -1) ➕ `src/oikb/http.py` (+61 -0) </details> ### 📄 Description Introduces detailed debug and info logs for sitemap parsing, link crawling, and page processing. Centralizes HTTP‑client creation via make_http_client() with OIKB_INSECURE_SSL support for self‑signed certificates. Extends the daemon with a --log‑level parameter for granular log control. For testability reasons, it is currently implemented only for the web‑connector. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
open-webui/oikb#93
No description provided.