[GH-ISSUE #1000] [Bug] ktransformers启动web服务为什么同网络下其他设备无法访问 #708

Closed
opened 2026-10-29 14:43:10 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @motu001 on GitHub (Mar 31, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1000

Checklist

  • 1. I have searched related issues but cannot get the expected help.
  • 2. The bug has not been fixed in the latest version.
  • 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
  • 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/kvcache-ai/ktransformers/discussions. Otherwise, it will be closed.
  • 5. To help the community, I will use Chinese/English or attach an Chinese/English translation if using another language. Non-Chinese/English content without translation may be closed.

Describe the bug

ktransformers启动web服务为什么同网络下其他设备无法访问,chatbox ollama api本机可以用,其他同网络设备也不行,其他openwebui只要填进去url保存就会卡死白屏(不填就不会)openwebui页面就打不开了,需要把kt web停了才开重新加载页面,dify试了也不行,怎么解决,防火墙全关了。还有什么其他方法吗。感谢!!

Reproduction

!

Environment

!

Originally created by @motu001 on GitHub (Mar 31, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1000 ### Checklist - [ ] 1. I have searched related issues but cannot get the expected help. - [ ] 2. The bug has not been fixed in the latest version. - [ ] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback. - [ ] 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/kvcache-ai/ktransformers/discussions. Otherwise, it will be closed. - [ ] 5. To help the community, I will use Chinese/English or attach an Chinese/English translation if using another language. Non-Chinese/English content without translation may be closed. ### Describe the bug ktransformers启动web服务为什么同网络下其他设备无法访问,chatbox ollama api本机可以用,其他同网络设备也不行,其他openwebui只要填进去url保存就会卡死白屏(不填就不会)openwebui页面就打不开了,需要把kt web停了才开重新加载页面,dify试了也不行,怎么解决,防火墙全关了。还有什么其他方法吗。感谢!! ### Reproduction ! ### Environment !
Author
Owner

@344303947 commented on GitHub (Mar 31, 2025):

port 设置成 0.0.0.0 试试呢

<!-- gh-comment-id:2765575744 --> @344303947 commented on GitHub (Mar 31, 2025): port 设置成 0.0.0.0 试试呢
Author
Owner

@motu001 commented on GitHub (Apr 1, 2025):

@344303947 改哪里的,默认不就是监听0.0.0.0吗

2025-04-01 08:37:09,646 DEBUG /root/miniconda3/envs/ktrans_main/lib/python3.12/site-packages/ktransformers/server/backend/context_manager.py[21]: Creating Context Manager
INFO: Started server process [1621941]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://0.0.0.0:10005 (Press CTRL+C to quit)
INFO: 192.168.51.122:47156 - "GET /v1/models HTTP/1.1" 200 OK
INFO: 192.168.51.122:47172 - "GET /v1/models HTTP/1.1" 200 OK
INFO: 192.168.51.122:47172 - "GET /v1/models HTTP/1.1" 200 OK
INFO: 192.168.51.122:40808 - "GET /v1/models HTTP/1.1" 200 OK

<!-- gh-comment-id:2767752157 --> @motu001 commented on GitHub (Apr 1, 2025): @344303947 改哪里的,默认不就是监听0.0.0.0吗 2025-04-01 08:37:09,646 DEBUG /root/miniconda3/envs/ktrans_main/lib/python3.12/site-packages/ktransformers/server/backend/context_manager.py[21]: Creating Context Manager INFO: Started server process [1621941] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:10005 (Press CTRL+C to quit) INFO: 192.168.51.122:47156 - "GET /v1/models HTTP/1.1" 200 OK INFO: 192.168.51.122:47172 - "GET /v1/models HTTP/1.1" 200 OK INFO: 192.168.51.122:47172 - "GET /v1/models HTTP/1.1" 200 OK INFO: 192.168.51.122:40808 - "GET /v1/models HTTP/1.1" 200 OK
Author
Owner

@motu001 commented on GitHub (Apr 1, 2025):

WebUI API请求URL问题 #515
参考有其他方法
我用dify openai 可以了

<!-- gh-comment-id:2768115343 --> @motu001 commented on GitHub (Apr 1, 2025): WebUI API请求URL问题 #515 参考有其他方法 我用dify openai 可以了
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#708
No description provided.