[PR #1154] [MERGED] Fix the error caused by the client not passing temperature and top_p being empty #1570

New issue

Closed

opened 2026-10-29 14:53:34 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 14:53:34 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/ktransformers/pull/1154
Author: @344303947
Created: 4/16/2025
Status: ✅ Merged
Merged: 4/17/2025
Merged by: @qiyuxinlin

Base: main ← Head: features/add-function-calling

📝 Commits (3)

8699109 Refactor the chat interface to support tool calling and parameter processing
badf7a1 Merge branch 'kvcache-ai:main' into features/add-function-calling
c8db24d Update config.py

📊 Changes

1 file changed (+19 additions, -9 deletions)

View changed files

📝 ktransformers/server/backend/interfaces/balance_serve.py (+19 -9)

📄 Description

Fix the error caused by the client not passing temperature and top_p being empty

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/ktransformers/pull/1154 **Author:** [@344303947](https://github.com/344303947) **Created:** 4/16/2025 **Status:** ✅ Merged **Merged:** 4/17/2025 **Merged by:** [@qiyuxinlin](https://github.com/qiyuxinlin) **Base:** `main` ← **Head:** `features/add-function-calling` --- ### 📝 Commits (3) - [`8699109`](https://github.com/kvcache-ai/ktransformers/commit/869910912929bc5c4a8493e726e0a9653d6073cd) Refactor the chat interface to support tool calling and parameter processing - [`badf7a1`](https://github.com/kvcache-ai/ktransformers/commit/badf7a1bb1b2fb1e23b1a9944b4e8f3c0d43ca22) Merge branch 'kvcache-ai:main' into features/add-function-calling - [`c8db24d`](https://github.com/kvcache-ai/ktransformers/commit/c8db24d5eb664d6540e7edd00aecb6c346a14087) Update config.py ### 📊 Changes **1 file changed** (+19 additions, -9 deletions) <details> <summary>View changed files</summary> 📝 `ktransformers/server/backend/interfaces/balance_serve.py` (+19 -9) </details> ### 📄 Description Fix the error caused by the client not passing temperature and top_p being empty --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 14:53:34 +00:00