[GH-ISSUE #203] Unhandled exception: Error during drmGetDevice for /dev/dri/renderD128, Invalid argument #136

Closed
opened 2026-10-15 12:57:02 +00:00 by bsakaguchi · 4 comments
Owner

Originally created by @lj189cn on GitHub (May 21, 2025).
Original GitHub issue: https://github.com/games-on-whales/wolf/issues/203

docker compose

version: "3"
services:
  wolf:
    image: 	gameonwhales/wolf:stable
    environment:
      - XDG_RUNTIME_DIR=/tmp/sockets
      - HOST_APPS_STATE_FOLDER=/etc/wolf
      - NVIDIA_DRIVER_CAPABILITIES=all
      - NVIDIA_VISIBLE_DEVICES=all
      - WOLF_RENDER_NODE=/dev/dri/renderD128
      - WOLF_LOG_LEVEL=DEBUG
    volumes:
      - /etc/wolf/:/etc/wolf
      - /tmp/sockets:/tmp/sockets:rw
      - /var/run/docker.sock:/var/run/docker.sock:rw
      - /dev/:/dev/:rw
      - /run/udev:/run/udev:rw
    device_cgroup_rules:
      - 'c 13:* rmw'
    devices:
      - /dev/dri
      - /dev/uinput
      - /dev/uhid

    runtime: nvidia
    deploy:
      resources:
        reservations:
          devices:
            - capabilities: [gpu]
    network_mode: host
    restart: unless-stopped

logs
_wolf-wolf-1_logs (9).txt

[#@archlinux ~]$ ls -l /sys/class/drm/renderD*/device/driver
lrwxrwxrwx 1 root root 0 May 21 00:47 /sys/class/drm/renderD128/device/driver -> ../../../../bus/pci/drivers/nvidia
[#@archlinux ~]$ ls /dev/dri
by-path  card0  card1  renderD128
Originally created by @lj189cn on GitHub (May 21, 2025). Original GitHub issue: https://github.com/games-on-whales/wolf/issues/203 docker compose ```yaml version: "3" services: wolf: image: gameonwhales/wolf:stable environment: - XDG_RUNTIME_DIR=/tmp/sockets - HOST_APPS_STATE_FOLDER=/etc/wolf - NVIDIA_DRIVER_CAPABILITIES=all - NVIDIA_VISIBLE_DEVICES=all - WOLF_RENDER_NODE=/dev/dri/renderD128 - WOLF_LOG_LEVEL=DEBUG volumes: - /etc/wolf/:/etc/wolf - /tmp/sockets:/tmp/sockets:rw - /var/run/docker.sock:/var/run/docker.sock:rw - /dev/:/dev/:rw - /run/udev:/run/udev:rw device_cgroup_rules: - 'c 13:* rmw' devices: - /dev/dri - /dev/uinput - /dev/uhid runtime: nvidia deploy: resources: reservations: devices: - capabilities: [gpu] network_mode: host restart: unless-stopped ``` logs [_wolf-wolf-1_logs (9).txt](https://github.com/user-attachments/files/20368294/_wolf-wolf-1_logs.9.txt) ``` [#@archlinux ~]$ ls -l /sys/class/drm/renderD*/device/driver lrwxrwxrwx 1 root root 0 May 21 00:47 /sys/class/drm/renderD128/device/driver -> ../../../../bus/pci/drivers/nvidia [#@archlinux ~]$ ls /dev/dri by-path card0 card1 renderD128 ```
Author
Owner

@lj189cn commented on GitHub (May 21, 2025):

It seems the driver wasn’t found. Could it be because of my graphics card here?
01:00.0 3D controller: NVIDIA Corporation GP104GL [Tesla P4] (rev a1)

<!-- gh-comment-id:2897863078 --> @lj189cn commented on GitHub (May 21, 2025): It seems the driver wasn’t found. Could it be because of my graphics card here? 01:00.0 3D controller: NVIDIA Corporation GP104GL [Tesla P4] (rev a1)
Author
Owner

@ABeltramo commented on GitHub (May 22, 2025):

Looks like Wolf can't access /dev/dri/renderD128 on your setup. The only thing that I could think of is if the Nvidia Container Toolkit is hiding the device inside the container for some reason. Could you try using the recommended Nvidia manual setup from the quickstart guide instead?

Also, does nvidia-smi works on the host? Not sure what you mean with "It seems the driver wasn’t found"..

<!-- gh-comment-id:2900392855 --> @ABeltramo commented on GitHub (May 22, 2025): Looks like Wolf can't access `/dev/dri/renderD128` on your setup. The only thing that I could think of is if the Nvidia Container Toolkit is hiding the device inside the container for some reason. Could you try using the recommended Nvidia manual setup from the [quickstart guide](https://games-on-whales.github.io/wolf/stable/user/quickstart.html) instead? Also, does `nvidia-smi` works on the host? Not sure what you mean with "It seems the driver wasn’t found"..
Author
Owner

@lj189cn commented on GitHub (May 22, 2025):

Nvidia Container Toolkit

root@archlinux:/sys/class/drm# ls -l *
lrwxrwxrwx 1 root root    0 May 20 17:37 card0 -> ../../devices/pci0000:00/0000:00:1c.7/0000:08:00.0/0000:09:00.0/drm/card0
lrwxrwxrwx 1 root root    0 May 20 17:37 card0-VGA-1 -> ../../devices/pci0000:00/0000:00:1c.7/0000:08:00.0/0000:09:00.0/drm/card0/card0-VGA-1
lrwxrwxrwx 1 root root    0 May 20 17:58 card1 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/drm/card1
lrwxrwxrwx 1 root root    0 May 20 17:47 renderD128 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/drm/renderD128
-r--r--r-- 1 root root 4096 May 22 11:16 version
root@archlinux:/sys/class/drm# nvidia-smi 
Thu May 22 11:18:07 2025       
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.216.01             Driver Version: 535.216.01   CUDA Version: 12.2     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  Tesla P4                       On  | 00000000:01:00.0 Off |                  Off |
| N/A   46C    P8               7W /  75W |     89MiB /  8192MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
                                                                                         
+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
+---------------------------------------------------------------------------------------+
root@archlinux:/sys/class/drm# 

=======================
Manual
NVIDIA-Linux-x86_64-535.216.01-grid .run. X
NVIDIA-Linux-x86_64-535.216.01 .run X

drwxr-xr-x 2 root root      100 May 20 17:37 by-path
crw-rw---- 1 root  985 226,   0 May 20 17:37 card0
crw-rw---- 1 root  985 226,   1 May 20 17:37 card1
crw-rw-rw- 1 root  989 226, 128 May 20 17:37 renderD128
root@archlinux:/wolf# ls -l /sys/class/drm/
card0/       card0-VGA-1/ card1/       renderD128/  version      
root@archlinux:/wolf# ls -l /sys/class/drm/*
lrwxrwxrwx 1 root root    0 May 20 17:37 /sys/class/drm/card0 -> ../../devices/pci0000:00/0000:00:1c.7/0000:08:00.0/0000:09:00.0/drm/card0
lrwxrwxrwx 1 root root    0 May 20 17:37 /sys/class/drm/card0-VGA-1 -> ../../devices/pci0000:00/0000:00:1c.7/0000:08:00.0/0000:09:00.0/drm/card0/card0-VGA-1
lrwxrwxrwx 1 root root    0 May 20 17:58 /sys/class/drm/card1 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/drm/card1
lrwxrwxrwx 1 root root    0 May 20 17:47 /sys/class/drm/renderD128 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/drm/renderD128
-r--r--r-- 1 root root 4096 May 22 11:16 /sys/class/drm/version
root@archlinux:/wolf# nvidia-smi 
bash: nvidia-smi: command not found
root@archlinux:/wolf# 

Unfortunately, both drives are the same. ( TT——TT)

<!-- gh-comment-id:2900714444 --> @lj189cn commented on GitHub (May 22, 2025): Nvidia Container Toolkit ``` root@archlinux:/sys/class/drm# ls -l * lrwxrwxrwx 1 root root 0 May 20 17:37 card0 -> ../../devices/pci0000:00/0000:00:1c.7/0000:08:00.0/0000:09:00.0/drm/card0 lrwxrwxrwx 1 root root 0 May 20 17:37 card0-VGA-1 -> ../../devices/pci0000:00/0000:00:1c.7/0000:08:00.0/0000:09:00.0/drm/card0/card0-VGA-1 lrwxrwxrwx 1 root root 0 May 20 17:58 card1 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/drm/card1 lrwxrwxrwx 1 root root 0 May 20 17:47 renderD128 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/drm/renderD128 -r--r--r-- 1 root root 4096 May 22 11:16 version root@archlinux:/sys/class/drm# nvidia-smi Thu May 22 11:18:07 2025 +---------------------------------------------------------------------------------------+ | NVIDIA-SMI 535.216.01 Driver Version: 535.216.01 CUDA Version: 12.2 | |-----------------------------------------+----------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+======================+======================| | 0 Tesla P4 On | 00000000:01:00.0 Off | Off | | N/A 46C P8 7W / 75W | 89MiB / 8192MiB | 0% Default | | | | N/A | +-----------------------------------------+----------------------+----------------------+ +---------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=======================================================================================| +---------------------------------------------------------------------------------------+ root@archlinux:/sys/class/drm# ``` ======================= Manual NVIDIA-Linux-x86_64-535.216.01-grid .run. X NVIDIA-Linux-x86_64-535.216.01 .run X ``` drwxr-xr-x 2 root root 100 May 20 17:37 by-path crw-rw---- 1 root 985 226, 0 May 20 17:37 card0 crw-rw---- 1 root 985 226, 1 May 20 17:37 card1 crw-rw-rw- 1 root 989 226, 128 May 20 17:37 renderD128 root@archlinux:/wolf# ls -l /sys/class/drm/ card0/ card0-VGA-1/ card1/ renderD128/ version root@archlinux:/wolf# ls -l /sys/class/drm/* lrwxrwxrwx 1 root root 0 May 20 17:37 /sys/class/drm/card0 -> ../../devices/pci0000:00/0000:00:1c.7/0000:08:00.0/0000:09:00.0/drm/card0 lrwxrwxrwx 1 root root 0 May 20 17:37 /sys/class/drm/card0-VGA-1 -> ../../devices/pci0000:00/0000:00:1c.7/0000:08:00.0/0000:09:00.0/drm/card0/card0-VGA-1 lrwxrwxrwx 1 root root 0 May 20 17:58 /sys/class/drm/card1 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/drm/card1 lrwxrwxrwx 1 root root 0 May 20 17:47 /sys/class/drm/renderD128 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/drm/renderD128 -r--r--r-- 1 root root 4096 May 22 11:16 /sys/class/drm/version root@archlinux:/wolf# nvidia-smi bash: nvidia-smi: command not found root@archlinux:/wolf# ``` Unfortunately, both drives are the same. ( TT——TT)
Author
Owner

@lj189cn commented on GitHub (May 22, 2025):

I use Portainer images to build gow/nvidia-driver. Not sure if there’s a connection between them.

<!-- gh-comment-id:2900751753 --> @lj189cn commented on GitHub (May 22, 2025): I use Portainer images to build gow/nvidia-driver. Not sure if there’s a connection between them.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
games-on-whales/wolf#136
No description provided.