[PR #691] [MERGED] feat:implementation of chat routing for Ollama #1460

New issue

Closed

opened 2026-10-29 14:52:37 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 14:52:37 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/ktransformers/pull/691
Author: @codewhisperer-rs
Created: 2/26/2025
Status: ✅ Merged
Merged: 2/27/2025
Merged by: @qiyuxinlin

Base: main ← Head: ollama_api_chat

📝 Commits (2)

68e7df3 implementation of chat routing for Ollama
ec7e912 modify

📊 Changes

1 file changed (+94 additions, -39 deletions)

View changed files

📝 ktransformers/server/api/ollama/completions.py (+94 -39)

📄 Description

@Atream we discovered that the /api/chat endpoint in Ollama was not implemented, so we implemented it ourselves.Through our test,the code can be used.Please check it.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/ktransformers/pull/691 **Author:** [@codewhisperer-rs](https://github.com/codewhisperer-rs) **Created:** 2/26/2025 **Status:** ✅ Merged **Merged:** 2/27/2025 **Merged by:** [@qiyuxinlin](https://github.com/qiyuxinlin) **Base:** `main` ← **Head:** `ollama_api_chat` --- ### 📝 Commits (2) - [`68e7df3`](https://github.com/kvcache-ai/ktransformers/commit/68e7df3a251650995384740a62b678310c7c73c2) implementation of chat routing for Ollama - [`ec7e912`](https://github.com/kvcache-ai/ktransformers/commit/ec7e912feed51db8c247e96ea582a9427966134a) modify ### 📊 Changes **1 file changed** (+94 additions, -39 deletions) <details> <summary>View changed files</summary> 📝 `ktransformers/server/api/ollama/completions.py` (+94 -39) </details> ### 📄 Description @Atream we discovered that the /api/chat endpoint in Ollama was not implemented, so we implemented it ourselves.Through our test,the code can be used.Please check it. ![QQ_1740569801685](https://github.com/user-attachments/assets/d12a63a0-ad4d-4e78-b1e4-00503559d42b) --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 14:52:37 +00:00