[PR #6] [MERGED] feat: Enable Browser-Based Benchmarks, Add Chat UI Benchmark #6

New issue

Closed

opened 2026-10-18 14:01:27 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-18 14:01:27 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/open-webui/benchmark/pull/6
Author: @james-westbrook
Created: 1/25/2026
Status: ✅ Merged
Merged: 1/28/2026
Merged by: @tjbck

Base: main ← Head: feat-browser-benchmarks

📝 Commits (10+)

488e60a feat: add chat-api benchmark
99f25f0 fix: status bar updates during script runs
57039da Merge branch 'fix-status-bar' into feat-ai-response-benchmark
c25e19d feat: add progress bar to chat-api benchmark
1cd8cd4 feat: add new browser-based client and chat UI benchmark
d73c847 docs: update README with browser install info
0687c2a fix: better handling for more concurrent users
ac7157d feat: add accurate error counting, better defaults
1f19899 docs: convey accurate defaults, show how to run other benchmarks
8b1bf5c fix: organize results into folders

📊 Changes

14 files changed (+2085 additions, -79 deletions)

View changed files

📝 .env.example (+17 -1)
📝 README.md (+158 -16)
📝 benchmark/cli.py (+160 -11)
➕ benchmark/clients/browser_client.py (+496 -0)
📝 benchmark/clients/http_client.py (+238 -2)
📝 benchmark/core/config.py (+67 -0)
📝 benchmark/core/metrics.py (+92 -0)
📝 benchmark/core/runner.py (+34 -41)
📝 benchmark/scenarios/__init__.py (+6 -2)
📝 benchmark/scenarios/channels.py (+5 -5)
➕ benchmark/scenarios/chat.py (+270 -0)
➕ benchmark/scenarios/chat_ui.py (+540 -0)
📝 docker/docker-compose.benchmark.yaml (+1 -1)
📝 pyproject.toml (+1 -0)

📄 Description

Also includes other fixes around status bars during benchmark runs, adds new env vars, and updates documentation.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/benchmark/pull/6 **Author:** [@james-westbrook](https://github.com/james-westbrook) **Created:** 1/25/2026 **Status:** ✅ Merged **Merged:** 1/28/2026 **Merged by:** [@tjbck](https://github.com/tjbck) **Base:** `main` ← **Head:** `feat-browser-benchmarks` --- ### 📝 Commits (10+) - [`488e60a`](https://github.com/open-webui/benchmark/commit/488e60adc28e123823ec476e27b0aa14d4e62e3f) feat: add chat-api benchmark - [`99f25f0`](https://github.com/open-webui/benchmark/commit/99f25f0aae66a576a25e99cd83397acdfe4f19a1) fix: status bar updates during script runs - [`57039da`](https://github.com/open-webui/benchmark/commit/57039daaf33aa294d0a39e7a1a7b311705432098) Merge branch 'fix-status-bar' into feat-ai-response-benchmark - [`c25e19d`](https://github.com/open-webui/benchmark/commit/c25e19d9d908d9244443cbf1415ab11ca04f7a37) feat: add progress bar to chat-api benchmark - [`1cd8cd4`](https://github.com/open-webui/benchmark/commit/1cd8cd4f61b2bcca4772c7bcaeb280cba1f515c3) feat: add new browser-based client and chat UI benchmark - [`d73c847`](https://github.com/open-webui/benchmark/commit/d73c8477089650ac4747ddb077f4d1c193e7207a) docs: update README with browser install info - [`0687c2a`](https://github.com/open-webui/benchmark/commit/0687c2a26d399434ab11d3c41ad3c5978d36b135) fix: better handling for more concurrent users - [`ac7157d`](https://github.com/open-webui/benchmark/commit/ac7157d0b529fa25cba3b355ba2eb6e49566b880) feat: add accurate error counting, better defaults - [`1f19899`](https://github.com/open-webui/benchmark/commit/1f198997cb88e074551955203b5efc8351079f13) docs: convey accurate defaults, show how to run other benchmarks - [`8b1bf5c`](https://github.com/open-webui/benchmark/commit/8b1bf5c64dd2e090f39d6e044d00496722e0e6d7) fix: organize results into folders ### 📊 Changes **14 files changed** (+2085 additions, -79 deletions) <details> <summary>View changed files</summary> 📝 `.env.example` (+17 -1) 📝 `README.md` (+158 -16) 📝 `benchmark/cli.py` (+160 -11) ➕ `benchmark/clients/browser_client.py` (+496 -0) 📝 `benchmark/clients/http_client.py` (+238 -2) 📝 `benchmark/core/config.py` (+67 -0) 📝 `benchmark/core/metrics.py` (+92 -0) 📝 `benchmark/core/runner.py` (+34 -41) 📝 `benchmark/scenarios/__init__.py` (+6 -2) 📝 `benchmark/scenarios/channels.py` (+5 -5) ➕ `benchmark/scenarios/chat.py` (+270 -0) ➕ `benchmark/scenarios/chat_ui.py` (+540 -0) 📝 `docker/docker-compose.benchmark.yaml` (+1 -1) 📝 `pyproject.toml` (+1 -0) </details> ### 📄 Description Also includes other fixes around status bars during benchmark runs, adds new env vars, and updates documentation. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-18 14:01:27 +00:00

closed this issue
added the
pull-request
label

No labels

pull-request

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

open-webui/benchmark#6

No description provided.

Rows
Columns