[GH-ISSUE #127] Can not install DeepGEMM with commit of `95e81b3` #75

New issue

Open

opened 2026-10-26 21:11:56 +00:00 by bsakaguchi · 1 comment

bsakaguchi commented

2026-10-26 21:11:56 +00:00

Owner

Originally created by @lxbworld on GitHub (Jul 11, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/127

I install deep_gemm for sglang, however, meet somg bug can't conquer:

command:

cd DeepGEMM
git submodule update --init --recursive
git checkout 95e81b3
pip install .

console print:

Traceback (most recent call last):
  File "/usr/local/bin/mineru-sglang-server", line 5, in <module>
    from mineru.cli.vlm_sglang_server import main
  File "/usr/local/lib/python3.10/dist-packages/mineru/cli/vlm_sglang_server.py", line 1, in <module>
    from ..model.vlm_sglang_model.server import main
  File "/usr/local/lib/python3.10/dist-packages/mineru/model/vlm_sglang_model/__init__.py", line 1, in <module>
    from sglang.srt.configs.model_config import multimodal_model_archs
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/configs/model_config.py", line 26, in <module>
    from sglang.srt.layers.quantization import QUANTIZATION_METHODS
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/layers/quantization/__init__.py", line 56, in <module>
    from sglang.srt.layers.quantization.blockwise_int8 import BlockInt8Config
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/layers/quantization/blockwise_int8.py", line 21, in <module>
    from sglang.srt.layers.quantization.utils import is_layer_skipped
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/layers/quantization/utils.py", line 8, in <module>
    from sglang.srt.layers.quantization.fp8_kernel import scaled_fp8_quant
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/layers/quantization/fp8_kernel.py", line 26, in <module>
    from sglang.srt.layers.quantization.deep_gemm import _ENABLE_JIT_DEEPGEMM
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/layers/quantization/deep_gemm.py", line 16, in <module>
    import deep_gemm
  File "/usr/local/lib/python3.10/dist-packages/deep_gemm/__init__.py", line 13, in <module>
    from .utils import bench, bench_kineto, calc_diff
  File "/usr/local/lib/python3.10/dist-packages/deep_gemm/utils/__init__.py", line 1, in <module>
    from . import layout, math
  File "/usr/local/lib/python3.10/dist-packages/deep_gemm/utils/layout.py", line 6, in <module>
    from ..jit.compiler import get_device_arch
ImportError: cannot import name 'get_device_arch' from 'deep_gemm.jit.compiler' (/usr/local/lib/python3.10/dist-packages/deep_gemm/jit/compiler.py)

I can not find get_device_arch in any files!! 😭

Originally created by @lxbworld on GitHub (Jul 11, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/127 I install deep_gemm for sglang, however, meet somg bug can't conquer: command: ```bash cd DeepGEMM git submodule update --init --recursive git checkout 95e81b3 pip install . ``` console print: ``` Traceback (most recent call last): File "/usr/local/bin/mineru-sglang-server", line 5, in <module> from mineru.cli.vlm_sglang_server import main File "/usr/local/lib/python3.10/dist-packages/mineru/cli/vlm_sglang_server.py", line 1, in <module> from ..model.vlm_sglang_model.server import main File "/usr/local/lib/python3.10/dist-packages/mineru/model/vlm_sglang_model/__init__.py", line 1, in <module> from sglang.srt.configs.model_config import multimodal_model_archs File "/usr/local/lib/python3.10/dist-packages/sglang/srt/configs/model_config.py", line 26, in <module> from sglang.srt.layers.quantization import QUANTIZATION_METHODS File "/usr/local/lib/python3.10/dist-packages/sglang/srt/layers/quantization/__init__.py", line 56, in <module> from sglang.srt.layers.quantization.blockwise_int8 import BlockInt8Config File "/usr/local/lib/python3.10/dist-packages/sglang/srt/layers/quantization/blockwise_int8.py", line 21, in <module> from sglang.srt.layers.quantization.utils import is_layer_skipped File "/usr/local/lib/python3.10/dist-packages/sglang/srt/layers/quantization/utils.py", line 8, in <module> from sglang.srt.layers.quantization.fp8_kernel import scaled_fp8_quant File "/usr/local/lib/python3.10/dist-packages/sglang/srt/layers/quantization/fp8_kernel.py", line 26, in <module> from sglang.srt.layers.quantization.deep_gemm import _ENABLE_JIT_DEEPGEMM File "/usr/local/lib/python3.10/dist-packages/sglang/srt/layers/quantization/deep_gemm.py", line 16, in <module> import deep_gemm File "/usr/local/lib/python3.10/dist-packages/deep_gemm/__init__.py", line 13, in <module> from .utils import bench, bench_kineto, calc_diff File "/usr/local/lib/python3.10/dist-packages/deep_gemm/utils/__init__.py", line 1, in <module> from . import layout, math File "/usr/local/lib/python3.10/dist-packages/deep_gemm/utils/layout.py", line 6, in <module> from ..jit.compiler import get_device_arch ImportError: cannot import name 'get_device_arch' from 'deep_gemm.jit.compiler' (/usr/local/lib/python3.10/dist-packages/deep_gemm/jit/compiler.py) ``` I can not find get_device_arch in any files!! 😭

bsakaguchi commented

2026-10-26 21:11:57 +00:00

Author

Owner

@yuho8818 commented on GitHub (Jul 11, 2025):

same question here

@yuho8818 commented on GitHub (Jul 11, 2025): same question here

No labels

pull-request

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

deepseek-ai/DeepGEMM#75

No description provided.

Rows
Columns

[GH-ISSUE #127] Can not install DeepGEMM with commit of 95e81b3 #75

[GH-ISSUE #127] Can not install DeepGEMM with commit of `95e81b3` #75