[GH-ISSUE #66] docker container fails to start due to missing package 'uvicorn' #31

New issue

Closed

opened 2026-10-29 14:32:50 +00:00 by bsakaguchi · 1 comment

bsakaguchi commented

2026-10-29 14:32:50 +00:00

Owner

Originally created by @sammcj on GitHub (Aug 29, 2024).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/66

Using the latest official Dockerfile ktransformers crashes on start due to a missing package:

docker logs -f ktransformers

Traceback (most recent call last):
  File "/opt/conda/bin/ktransformers", line 5, in <module>
    from ktransformers.server.main import main
  File "/opt/conda/lib/python3.10/site-packages/ktransformers/server/main.py", line 5, in <module>
    import uvicorn.logging
ModuleNotFoundError: No module named 'uvicorn'

compose for reference

...
services:
  &name ktransformers:
    <<: [*ai-common, *restart, *secopts, *autoupdate, *gpu]
    container_name: *name
    hostname: *name
    profiles:
      - *name
    build:
      context: https://github.com/kvcache-ai/ktransformers.git#main
      dockerfile: Dockerfile
    ports:
      - 10002/tcp
    volumes:
      - /mnt/llm/models:/models
      - ./ktransformers:/config/
    command:
      - "ktransformers"
      - "serve"
      - "--port"
      - "10002"
      - "--gguf_path"
      - "/models/deepseek-coder-v2-instruct/DeepSeek-Coder-V2-Instruct-Q4_K_M.gguf"
      - "--web True"
      - "--optimize_rule_path"
      - "/config/deepseek-coder-v2-3gpu.yaml"
    networks:
      - traefik-servicenet
    labels:
      traefik.enable: true
      org.hotio.pullio.update: true
      traefik.http.routers.ktransformers.rule: Host(`ktransformers.my.internal.domain`)
      traefik.http.routers.ktransformers.tls.certresolver: le
      traefik.http.routers.ktransformers.entrypoints: websecure
      traefik.http.routers.ktransformers.tls.domains[0].main: "*.my.internal.domain"
      traefik.http.routers.ktransformers.service: ktransformers-service
      traefik.http.services.ktransformers-service.loadbalancer.server.port: 10002
      traefik.http.routers.ktransformers.middlewares: authentik

Originally created by @sammcj on GitHub (Aug 29, 2024). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/66 Using the latest official Dockerfile ktransformers crashes on start due to a missing package: ``` docker logs -f ktransformers Traceback (most recent call last): File "/opt/conda/bin/ktransformers", line 5, in <module> from ktransformers.server.main import main File "/opt/conda/lib/python3.10/site-packages/ktransformers/server/main.py", line 5, in <module> import uvicorn.logging ModuleNotFoundError: No module named 'uvicorn' ``` --- compose for reference ``` ... services: &name ktransformers: <<: [*ai-common, *restart, *secopts, *autoupdate, *gpu] container_name: *name hostname: *name profiles: - *name build: context: https://github.com/kvcache-ai/ktransformers.git#main dockerfile: Dockerfile ports: - 10002/tcp volumes: - /mnt/llm/models:/models - ./ktransformers:/config/ command: - "ktransformers" - "serve" - "--port" - "10002" - "--gguf_path" - "/models/deepseek-coder-v2-instruct/DeepSeek-Coder-V2-Instruct-Q4_K_M.gguf" - "--web True" - "--optimize_rule_path" - "/config/deepseek-coder-v2-3gpu.yaml" networks: - traefik-servicenet labels: traefik.enable: true org.hotio.pullio.update: true traefik.http.routers.ktransformers.rule: Host(`ktransformers.my.internal.domain`) traefik.http.routers.ktransformers.tls.certresolver: le traefik.http.routers.ktransformers.entrypoints: websecure traefik.http.routers.ktransformers.tls.domains[0].main: "*.my.internal.domain" traefik.http.routers.ktransformers.service: ktransformers-service traefik.http.services.ktransformers-service.loadbalancer.server.port: 10002 traefik.http.routers.ktransformers.middlewares: authentik ```

bsakaguchi closed this issue

2026-10-29 14:32:51 +00:00

bsakaguchi commented

2026-10-29 14:32:51 +00:00

Author

Owner

@UnicornChan commented on GitHub (Aug 30, 2024):

I'm very sorry, when we built it, the FastAPI version was 0.111.0, which downloaded uvicorn as a dependency. Now the FastAPI version has been updated to 0.112.2, and uvicorn is no longer a dependency, which has caused the startup failure. I will rebuild an image for testing in a clean environment.

@UnicornChan commented on GitHub (Aug 30, 2024): I'm very sorry, when we built it, the FastAPI version was 0.111.0, which downloaded uvicorn as a dependency. Now the FastAPI version has been updated to 0.112.2, and uvicorn is no longer a dependency, which has caused the startup failure. I will rebuild an image for testing in a clean environment.

bsakaguchi referenced this issue

2026-10-29 14:45:29 +00:00

[GH-ISSUE #1269] [Question] benchmark with evalscope failed #859

bsakaguchi referenced this issue

2026-10-29 14:45:38 +00:00

[GH-ISSUE #1286] [Bug] inference_context.v_cache[0][i] IndexError: list index out of range #871

bsakaguchi referenced this issue

2026-10-29 14:45:39 +00:00

[GH-ISSUE #1288] [Bug] #876