[PR #532] [MERGED] fix: fix SSE formatting #1430

New issue

Closed

opened 2026-10-29 14:52:22 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 14:52:22 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/ktransformers/pull/532
Author: @xv44586
Created: 2/20/2025
Status: ✅ Merged
Merged: 2/27/2025
Merged by: @Atream

Base: main ← Head: fix-sse-formatting

📝 Commits (1)

b05cc56 fix: fix SSE formatting

📊 Changes

2 files changed (+2 additions, -2 deletions)

View changed files

📝 ktransformers/server/schemas/assistants/streaming.py (+1 -1)
📝 ktransformers/server/schemas/endpoints/chat.py (+1 -1)

📄 Description

fix SSE message formatting to compatible with OpenAI like:

data: {"id":"0195222dbb7be63bfc4895e2a27b9443","object":"chat.completion.chunk","created":1740035177,"model":"DeepSeek-R1","choices":[{"index":0,"delta":{"content":"","reasoning_content":null},"finish_reason":"stop","content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false}}}],"system_fingerprint":"","usage":{"prompt_tokens":22,"completion_tokens":8,"total_tokens":30}}

...
data: [DONE]

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/ktransformers/pull/532 **Author:** [@xv44586](https://github.com/xv44586) **Created:** 2/20/2025 **Status:** ✅ Merged **Merged:** 2/27/2025 **Merged by:** [@Atream](https://github.com/Atream) **Base:** `main` ← **Head:** `fix-sse-formatting` --- ### 📝 Commits (1) - [`b05cc56`](https://github.com/kvcache-ai/ktransformers/commit/b05cc5685d529ee76744dbfada21b656f9a0f4e0) fix: fix SSE formatting ### 📊 Changes **2 files changed** (+2 additions, -2 deletions) <details> <summary>View changed files</summary> 📝 `ktransformers/server/schemas/assistants/streaming.py` (+1 -1) 📝 `ktransformers/server/schemas/endpoints/chat.py` (+1 -1) </details> ### 📄 Description fix SSE message formatting to compatible with OpenAI like: ```bash data: {"id":"0195222dbb7be63bfc4895e2a27b9443","object":"chat.completion.chunk","created":1740035177,"model":"DeepSeek-R1","choices":[{"index":0,"delta":{"content":"","reasoning_content":null},"finish_reason":"stop","content_filter_results":{"hate":{"filtered":false},"self_harm":{"filtered":false},"sexual":{"filtered":false},"violence":{"filtered":false}}}],"system_fingerprint":"","usage":{"prompt_tokens":22,"completion_tokens":8,"total_tokens":30}} ... data: [DONE] ``` --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 14:52:22 +00:00