config.js' #691

New issue

Open

opened 2026-10-29 14:42:56 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-29 14:42:56 +00:00

Owner

Originally created by @devinliswe on GitHub (Mar 25, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/975

Checklist

1. I have searched related issues but cannot get the expected help.
2. The bug has not been fixed in the latest version.
3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/kvcache-ai/ktransformers/discussions. Otherwise, it will be closed.
5. To help the community, I will use Chinese/English or attach an Chinese/English translation if using another language. Non-Chinese/English content without translation may be closed.

Describe the bug

我在执行这个命令，报错了，执行local.chat没有问题，请大佬帮忙看下是什么原因，谢谢！
配置
cpu:e5 2686v4
ddr3 256g
2080ti 22G x2 改了DeepSeek-V3-Chat-multi-gpu.yaml中的算子
命令
ktransformers --model_path /media/liwenliang/data/llm/lmstudio-community/Deepseek-R1-UD-Q2_K_XL_GGUF --gguf_path /media/liwenliang/data/llm/lmstudio-community/Deepseek-R1-UD-Q2_K_XL_GGUF --cpu_infer 16 --optimize_config_path /home/liwenliang/ktransformers/ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu.yaml --max_new_tokens 4096 --port 10002 --web True
使用master分支编译的
报错信息
2025-03-25 23:51:07,623 INFO /home/liwenliang/miniconda3/envs/ktransformers/lib/ python3.11/site-packages/ktransformers/server/main.py[29]: Creating SQL tables
2025-03-25 23:51:07,628 INFO /home/liwenliang/miniconda3/envs/ktransformers/lib/ python3.11/site-packages/ktransformers/server/api/openai/assistants/assistants.p y[75]: Creating default assistant
Traceback (most recent call last):
File "/home/liwenliang/miniconda3/envs/ktransformers/bin/ktransformers", line 8, in
sys.exit(main())
^^^^^^
File "/home/liwenliang/miniconda3/envs/ktransformers/lib/python3.11/site-packa ges/ktransformers/server/main.py", line 113, in main
app = create_app()
^^^^^^^^^^^^
File "/home/liwenliang/miniconda3/envs/ktransformers/lib/python3.11/site-packa ges/ktransformers/server/main.py", line 48, in create_app
mount_index_routes(app)
File "/home/liwenliang/miniconda3/envs/ktransformers/lib/python3.11/site-packa ges/ktransformers/server/main.py", line 68, in mount_index_routes
update_web_port(web_config_file)
File "/home/liwenliang/miniconda3/envs/ktransformers/lib/python3.11/site-packa ges/ktransformers/server/main.py", line 56, in update_web_port
with open(config_file, "r", encoding="utf-8") as f_cfg:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/home/liwenliang/minico nda3/envs/ktransformers/lib/python3.11/site-packages/ktransformers/website/dist/config.js'

Reproduction

ktransformers --model_path /media/liwenliang/data/llm/lmstudio-community/Deepseek-R1-UD-Q2_K_XL_GGUF --gguf_path /media/liwenliang/data/llm/lmstudio-community/Deepseek-R1-UD-Q2_K_XL_GGUF --cpu_infer 16 --optimize_config_path /home/liwenliang/ktransformers/ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu.yaml --max_new_tokens 4096 --port 10002 --web True

Environment

配置
cpu:e5 2686v4
ddr3 256g
2080ti 22G x2 改了DeepSeek-V3-Chat-multi-gpu.yaml中的算子

Originally created by @devinliswe on GitHub (Mar 25, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/975 ### Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [ ] 2. The bug has not been fixed in the latest version. - [ ] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback. - [ ] 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/kvcache-ai/ktransformers/discussions. Otherwise, it will be closed. - [ ] 5. To help the community, I will use Chinese/English or attach an Chinese/English translation if using another language. Non-Chinese/English content without translation may be closed. ### Describe the bug 我在执行这个命令，报错了，执行local.chat没有问题，请大佬帮忙看下是什么原因，谢谢！配置 cpu:e5 2686v4 ddr3 256g 2080ti 22G x2 改了DeepSeek-V3-Chat-multi-gpu.yaml中的算子命令 ktransformers --model_path /media/liwenliang/data/llm/lmstudio-community/Deepseek-R1-UD-Q2_K_XL_GGUF --gguf_path /media/liwenliang/data/llm/lmstudio-community/Deepseek-R1-UD-Q2_K_XL_GGUF --cpu_infer 16 --optimize_config_path /home/liwenliang/ktransformers/ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu.yaml --max_new_tokens 4096 --port 10002 --web True 使用master分支编译的报错信息 2025-03-25 23:51:07,623 INFO /home/liwenliang/miniconda3/envs/ktransformers/lib/ python3.11/site-packages/ktransformers/server/main.py[29]: Creating SQL tables 2025-03-25 23:51:07,628 INFO /home/liwenliang/miniconda3/envs/ktransformers/lib/ python3.11/site-packages/ktransformers/server/api/openai/assistants/assistants.p y[75]: Creating default assistant Traceback (most recent call last): File "/home/liwenliang/miniconda3/envs/ktransformers/bin/ktransformers", line 8, in sys.exit(main()) ^^^^^^ File "/home/liwenliang/miniconda3/envs/ktransformers/lib/python3.11/site-packa ges/ktransformers/server/main.py", line 113, in main app = create_app() ^^^^^^^^^^^^ File "/home/liwenliang/miniconda3/envs/ktransformers/lib/python3.11/site-packa ges/ktransformers/server/main.py", line 48, in create_app mount_index_routes(app) File "/home/liwenliang/miniconda3/envs/ktransformers/lib/python3.11/site-packa ges/ktransformers/server/main.py", line 68, in mount_index_routes update_web_port(web_config_file) File "/home/liwenliang/miniconda3/envs/ktransformers/lib/python3.11/site-packa ges/ktransformers/server/main.py", line 56, in update_web_port with open(config_file, "r", encoding="utf-8") as f_cfg: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/home/liwenliang/minico nda3/envs/ktransformers/lib/python3.11/site-packages/ktransformers/website/dist/config.js' ### Reproduction ktransformers --model_path /media/liwenliang/data/llm/lmstudio-community/Deepseek-R1-UD-Q2_K_XL_GGUF --gguf_path /media/liwenliang/data/llm/lmstudio-community/Deepseek-R1-UD-Q2_K_XL_GGUF --cpu_infer 16 --optimize_config_path /home/liwenliang/ktransformers/ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu.yaml --max_new_tokens 4096 --port 10002 --web True ### Environment 配置 cpu:e5 2686v4 ddr3 256g 2080ti 22G x2 改了DeepSeek-V3-Chat-multi-gpu.yaml中的算子

bsakaguchi commented

2026-10-29 14:42:57 +00:00

Author

Owner

@Yangshirui01 commented on GitHub (Apr 2, 2025):

same as me

@Yangshirui01 commented on GitHub (Apr 2, 2025): same as me

bsakaguchi commented

2026-10-29 14:42:57 +00:00

Author

Owner

@KathySkyer commented on GitHub (May 16, 2025):