[PR #1163] [MERGED] Enh: Make Ollama perf data more accurate, consistent with OpenAI's implementation #1575

New issue

Closed

opened 2026-10-29 14:53:36 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 14:53:36 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/ktransformers/pull/1163
Author: @cyhasuka
Created: 4/17/2025
Status: ✅ Merged
Merged: 4/18/2025
Merged by: @Atream

Base: main ← Head: main

📝 Commits (2)

8ce34b3 Modify the performance calculation module
eff5bbc Merge branch 'kvcache-ai:main' into main

📊 Changes

1 file changed (+24 additions, -21 deletions)

View changed files

📝 ktransformers/server/api/ollama/completions.py (+24 -21)

📄 Description

Modify the performance data source of the Ollama backend to be consistent with the inference return data and no longer estimate it.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/ktransformers/pull/1163 **Author:** [@cyhasuka](https://github.com/cyhasuka) **Created:** 4/17/2025 **Status:** ✅ Merged **Merged:** 4/18/2025 **Merged by:** [@Atream](https://github.com/Atream) **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (2) - [`8ce34b3`](https://github.com/kvcache-ai/ktransformers/commit/8ce34b3b5c53ace0848263f6e146a550eb94bf3a) Modify the performance calculation module - [`eff5bbc`](https://github.com/kvcache-ai/ktransformers/commit/eff5bbc202621e690969e0bdd95249acd8f3a7bc) Merge branch 'kvcache-ai:main' into main ### 📊 Changes **1 file changed** (+24 additions, -21 deletions) <details> <summary>View changed files</summary> 📝 `ktransformers/server/api/ollama/completions.py` (+24 -21) </details> ### 📄 Description Modify the performance data source of the Ollama backend to be consistent with the inference return data and no longer estimate it. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 14:53:36 +00:00