mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #1831] conda环境下cmake4.1.2本地编译kt-kernel报错 #1143
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#1143
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @toseekin on GitHub (Feb 3, 2026).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1831
Reminder
System Info
系统信息如下：
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 46 bits physical, 57 bits virtual
CPU(s): 48
On-line CPU(s) list: 0-47
Thread(s) per core: 2
Core(s) per socket: 12
Socket(s): 2
NUMA node(s): 2
Vendor ID: GenuineIntel
CPU family: 6
Model: 106
Model name: Intel(R) Xeon(R) Gold 5317 CPU @ 3.00GHz
Stepping: 6
CPU MHz: 1052.295
CPU max MHz: 3600.0000
CPU min MHz: 800.0000
BogoMIPS: 6000.00
Virtualization: VT-x
L1d cache: 1.1 MiB
L1i cache: 768 KiB
L2 cache: 30 MiB
L3 cache: 36 MiB
NUMA node0 CPU(s): 0-11,24-35
NUMA node1 CPU(s): 12-23,36-47
Vulnerability Gather data sampling: Mitigation; Microcode
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Mitigation; Clear CPU buffers; SMT vulnerable
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccom
p
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitizati
on
Vulnerability Spectre v2: Mitigation; Enhanced / Automatic IBRS; IBPB conditional; RSB filli
ng; PBRSB-eIBRS SW sequence; BHI SW loop, KVM SW loop
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat
pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx p
dpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good n
opl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 ds
_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1
sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c
rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 invpcid_si
ngle intel_ppin ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shadow
vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 sm
ep bmi2 erms invpcid cqm rdt_a avx512f avx512dq rdseed adx smap av
x512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512v
l xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_tot
al cqm_mbm_local split_lock_detect wbnoinvd dtherm ida arat pln pt
s avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx5
12_vnni avx512_bitalg tme avx512_vpopcntdq la57 rdpid fsrm md_clea
r pconfig flush_l1d arch_capabilities
在conda环境下安装cmake4.1.2版本编译，conda环境中的gcc版本为11.4.0，python版本为3.12.12，cuda版本为12.8
Reproduction
按照链接https://bgithub.xyz/kvcache-ai/ktransformers/blob/main/doc/en/Kimi-K2.5.md中的步骤安装kt-kernel，执行./install.sh后出现下列报错信息：
Checking and installing system dependencies...
Installing cmake via conda...
Channels:
Platform: linux-64
Collecting package metadata (repodata.json): done
Solving environment: done
All requested packages already installed.
Detected Debian-based system. Installing libhwloc-dev and pkg-config...
Cleaning previous build directory: /home/sitonholy/Documents/ktransformers/kt-kernel/build
Auto-detecting CPU capabilities...
ℹ AMX instructions not detected
Configuration: NATIVE + AMX=OFF
✓ Using AVX512/AVX2 instructions
⚠️ IMPORTANT: This binary is optimized for THIS CPU only
To build portable binaries for distribution, use:
export CPUINFER_CPU_INSTRUCT=AVX512 # or AVX2
export CPUINFER_ENABLE_AMX=OFF
./install.sh build --manual
AVX512 Feature Detection:
AVX512F: ✓ Detected (foundation)
VNNI: ✓ Detected (hardware acceleration enabled)
BF16: ✗ Not detected (will use software fallback, 5-10x slower)
VBMI: ✓ Detected (byte permutation enabled)
Note: Software fallbacks ensure all code works on older CPUs
Note: FP8 MoE requires AVX512F + BF16 + VNNI + VBMI
Tip: Override with CPUINFER_ENABLE_AVX512_[VNNI|BF16|VBMI]=ON/OFF
To use manual configuration instead, run: ./install.sh build --manual
==========================================
Building kt-kernel with configuration:
CPUINFER_CPU_INSTRUCT = NATIVE
CPUINFER_ENABLE_AMX = OFF
CPUINFER_ENABLE_AVX512_VNNI = ON
CPUINFER_ENABLE_AVX512_BF16 = OFF
CPUINFER_ENABLE_AVX512_VBMI = ON
CPUINFER_BUILD_TYPE = Release
CPUINFER_PARALLEL = AUTO
CPUINFER_VERBOSE = 1
Using pip 25.3 from /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages/pip (python 3.12)
Looking in links: /home/sitonholy/Downloads/nvidia-cudnn-cu12
Processing /home/sitonholy/Documents/ktransformers/kt-kernel
Running command installing build dependencies
Using pip 25.3 from /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages/pip (python 3.12)
Looking in links: /home/sitonholy/Downloads/nvidia-cudnn-cu12
Processing /home/sitonholy/Downloads/nvidia-cudnn-cu12/setuptools-80.10.2-py3-none-any.whl
Processing /home/sitonholy/Downloads/nvidia-cudnn-cu12/wheel-0.46.3-py3-none-any.whl
Processing /home/sitonholy/Downloads/nvidia-cudnn-cu12/cmake-4.2.1-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Processing /home/sitonholy/Downloads/nvidia-cudnn-cu12/pybind11-3.0.1-py3-none-any.whl
Processing /home/sitonholy/Downloads/nvidia-cudnn-cu12/packaging-26.0-py3-none-any.whl (from wheel)
Installing collected packages: setuptools, pybind11, packaging, cmake, wheel
Creating /tmp/pip-build-env-7g91tvhj/overlay/bin
changing mode of /tmp/pip-build-env-7g91tvhj/overlay/bin/pybind11-config to 775
changing mode of /tmp/pip-build-env-7g91tvhj/overlay/bin/ccmake to 775
changing mode of /tmp/pip-build-env-7g91tvhj/overlay/bin/cmake to 775
changing mode of /tmp/pip-build-env-7g91tvhj/overlay/bin/cpack to 775
changing mode of /tmp/pip-build-env-7g91tvhj/overlay/bin/ctest to 775
changing mode of /tmp/pip-build-env-7g91tvhj/overlay/bin/wheel to 775
Successfully installed cmake-4.2.1 packaging-26.0 pybind11-3.0.1 setuptools-80.10.2 wheel-0.46.3
Installing build dependencies ... done
Running command Getting requirements to build wheel
/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsWarning:
licenseoverwritten bypyproject.tomlcorresp(dist, value, root_dir)
-- Version: 0.5.0.post1
-- Building kt-kernel (CPU-only multi-variant)
running egg_info
writing kt_kernel.egg-info/PKG-INFO
writing dependency_links to kt_kernel.egg-info/dependency_links.txt
writing entry points to kt_kernel.egg-info/entry_points.txt
writing requirements to kt_kernel.egg-info/requires.txt
writing top-level names to kt_kernel.egg-info/top_level.txt
reading manifest file 'kt_kernel.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'LICENSE'
warning: no files found matching '.in' under directory 'cmake'
warning: no files found matching '.hpp' under directory 'cpu_backend'
warning: no files found matching '.c' under directory 'cpu_backend'
warning: no files found matching '.cc' under directory 'cpu_backend'
warning: no files found matching '.c' under directory 'operators'
warning: no files found matching '.cc' under directory 'operators'
warning: no previously-included files matching '.pyc' found anywhere in distribution
warning: no previously-included files matching '.pyo' found anywhere in distribution
warning: no previously-included files matching 'pycache' found anywhere in distribution
warning: no previously-included files matching '.git*' found anywhere in distribution
warning: no previously-included files matching '.so' found anywhere in distribution
warning: no previously-included files matching '.o' found anywhere in distribution
warning: no previously-included files matching '.a' found anywhere in distribution
warning: no previously-included files matching 'build' found anywhere in distribution
warning: no previously-included files matching 'dist' found anywhere in distribution
warning: no previously-included files matching '.egg-info' found anywhere in distribution
writing manifest file 'kt_kernel.egg-info/SOURCES.txt'
Getting requirements to build wheel ... done
Running command Preparing metadata (pyproject.toml)
/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsWarning:
licenseoverwritten bypyproject.tomlcorresp(dist, value, root_dir)
-- Version: 0.5.0.post1
-- Building kt-kernel (CPU-only multi-variant)
running dist_info
creating /tmp/pip-modern-metadata-wujsjzzp/kt_kernel.egg-info
writing /tmp/pip-modern-metadata-wujsjzzp/kt_kernel.egg-info/PKG-INFO
writing dependency_links to /tmp/pip-modern-metadata-wujsjzzp/kt_kernel.egg-info/dependency_links.txt
writing entry points to /tmp/pip-modern-metadata-wujsjzzp/kt_kernel.egg-info/entry_points.txt
writing requirements to /tmp/pip-modern-metadata-wujsjzzp/kt_kernel.egg-info/requires.txt
writing top-level names to /tmp/pip-modern-metadata-wujsjzzp/kt_kernel.egg-info/top_level.txt
writing manifest file '/tmp/pip-modern-metadata-wujsjzzp/kt_kernel.egg-info/SOURCES.txt'
reading manifest file '/tmp/pip-modern-metadata-wujsjzzp/kt_kernel.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'LICENSE'
warning: no files found matching '.in' under directory 'cmake'
warning: no files found matching '.hpp' under directory 'cpu_backend'
warning: no files found matching '.c' under directory 'cpu_backend'
warning: no files found matching '.cc' under directory 'cpu_backend'
warning: no files found matching '.c' under directory 'operators'
warning: no files found matching '.cc' under directory 'operators'
warning: no previously-included files matching '.pyc' found anywhere in distribution
warning: no previously-included files matching '.pyo' found anywhere in distribution
warning: no previously-included files matching 'pycache' found anywhere in distribution
warning: no previously-included files matching '.git*' found anywhere in distribution
warning: no previously-included files matching '.so' found anywhere in distribution
warning: no previously-included files matching '.o' found anywhere in distribution
warning: no previously-included files matching '.a' found anywhere in distribution
warning: no previously-included files matching 'build' found anywhere in distribution
warning: no previously-included files matching 'dist' found anywhere in distribution
warning: no previously-included files matching '.egg-info' found anywhere in distribution
writing manifest file '/tmp/pip-modern-metadata-wujsjzzp/kt_kernel.egg-info/SOURCES.txt'
creating '/tmp/pip-modern-metadata-wujsjzzp/kt_kernel-0.5.0.post1.dist-info'
Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: torch>=2.0.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (2.9.1+cu128)
Requirement already satisfied: safetensors>=0.4.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (0.7.0)
Requirement already satisfied: compressed-tensors>=0.7.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (0.13.0)
Requirement already satisfied: numpy>=1.24.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (2.4.1)
Requirement already satisfied: triton>=2.0.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (3.5.1)
Requirement already satisfied: gguf>=0.17.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (0.17.1)
Requirement already satisfied: typer>=0.9.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from typer[all]>=0.9.0->kt-kernel==0.5.0.post1) (0.21.1)
Requirement already satisfied: rich>=13.0.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (14.3.1)
Requirement already satisfied: pyyaml>=6.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (6.0.3)
Requirement already satisfied: httpx>=0.25.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (0.28.1)
Requirement already satisfied: packaging>=23.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (25.0)
Requirement already satisfied: black>=25.9.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from kt-kernel==0.5.0.post1) (26.1.0)
Requirement already satisfied: click>=8.0.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from black>=25.9.0->kt-kernel==0.5.0.post1) (8.3.1)
Requirement already satisfied: mypy-extensions>=0.4.3 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from black>=25.9.0->kt-kernel==0.5.0.post1) (1.1.0)
Requirement already satisfied: pathspec>=1.0.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from black>=25.9.0->kt-kernel==0.5.0.post1) (1.0.4)
Requirement already satisfied: platformdirs>=2 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from black>=25.9.0->kt-kernel==0.5.0.post1) (4.5.1)
Requirement already satisfied: pytokens>=0.3.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from black>=25.9.0->kt-kernel==0.5.0.post1) (0.4.1)
Requirement already satisfied: transformers in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (4.57.1)
Requirement already satisfied: pydantic>=2.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.12.5)
Requirement already satisfied: loguru in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.7.3)
Requirement already satisfied: tqdm>=4.27 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from gguf>=0.17.0->kt-kernel==0.5.0.post1) (4.67.1)
Requirement already satisfied: anyio in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (4.12.1)
Requirement already satisfied: certifi in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (2026.1.4)
Requirement already satisfied: httpcore==1.* in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (1.0.9)
Requirement already satisfied: idna in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from httpx>=0.25.0->kt-kernel==0.5.0.post1) (3.11)
Requirement already satisfied: h11>=0.16 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from httpcore==1.->httpx>=0.25.0->kt-kernel==0.5.0.post1) (0.16.0)
Requirement already satisfied: annotated-types>=0.6.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from pydantic>=2.0->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.7.0)
Requirement already satisfied: pydantic-core==2.41.5 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from pydantic>=2.0->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.41.5)
Requirement already satisfied: typing-extensions>=4.14.1 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from pydantic>=2.0->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (4.15.0)
Requirement already satisfied: typing-inspection>=0.4.2 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from pydantic>=2.0->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.4.2)
Requirement already satisfied: markdown-it-py>=2.2.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from rich>=13.0.0->kt-kernel==0.5.0.post1) (4.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from rich>=13.0.0->kt-kernel==0.5.0.post1) (2.19.2)
Requirement already satisfied: mdurl~=0.1 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from markdown-it-py>=2.2.0->rich>=13.0.0->kt-kernel==0.5.0.post1) (0.1.2)
Requirement already satisfied: filelock in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.20.3)
Requirement already satisfied: setuptools in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (80.10.1)
Requirement already satisfied: sympy>=1.13.3 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (1.14.0)
Requirement already satisfied: networkx>=2.5.1 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.6.1)
Requirement already satisfied: jinja2 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.1.6)
Requirement already satisfied: fsspec>=0.8.5 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (2025.10.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.93 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.93)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.90 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.90)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.90 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.90)
Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (9.10.2.21)
Requirement already satisfied: nvidia-cublas-cu12==12.8.4.1 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.4.1)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.83 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (11.3.3.83)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.90 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (10.3.9.90)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.3.90 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (11.7.3.90)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.8.93 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.5.8.93)
Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (0.7.1)
Requirement already satisfied: nvidia-nccl-cu12==2.27.5 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (2.27.5)
Requirement already satisfied: nvidia-nvshmem-cu12==3.3.20 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (3.3.20)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.90 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.90)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.93 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (12.8.93)
Requirement already satisfied: nvidia-cufile-cu12==1.13.1.3 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from torch>=2.0.0->kt-kernel==0.5.0.post1) (1.13.1.3)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from sympy>=1.13.3->torch>=2.0.0->kt-kernel==0.5.0.post1) (1.3.0)
Requirement already satisfied: shellingham>=1.3.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from typer>=0.9.0->typer[all]>=0.9.0->kt-kernel==0.5.0.post1) (1.5.4)
WARNING: typer 0.21.1 does not provide the extra 'all'
Requirement already satisfied: MarkupSafe>=2.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from jinja2->torch>=2.0.0->kt-kernel==0.5.0.post1) (3.0.3)
Requirement already satisfied: huggingface-hub<1.0,>=0.34.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.36.0)
Requirement already satisfied: regex!=2019.12.17 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2026.1.15)
Requirement already satisfied: requests in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.32.5)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (0.22.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from huggingface-hub<1.0,>=0.34.0->transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (1.2.0)
Requirement already satisfied: charset_normalizer<4,>=2 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from requests->transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (3.4.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages (from requests->transformers->compressed-tensors>=0.7.0->kt-kernel==0.5.0.post1) (2.6.3)
Building wheels for collected packages: kt-kernel
Running command Building wheel for kt-kernel (pyproject.toml)
/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsWarning:
licenseoverwritten bypyproject.tomlcorresp(dist, value, root_dir)
-- Version: 0.5.0.post1
-- Building kt-kernel (CPU-only multi-variant)
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-cpython-312/kt_kernel
copying python/experts.py -> build/lib.linux-x86_64-cpython-312/kt_kernel
copying python/experts_base.py -> build/lib.linux-x86_64-cpython-312/kt_kernel
copying python/_cpu_detect.py -> build/lib.linux-x86_64-cpython-312/kt_kernel
copying python/init.py -> build/lib.linux-x86_64-cpython-312/kt_kernel
creating build/lib.linux-x86_64-cpython-312/kt_kernel/utils
copying python/utils/loader.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/utils
copying python/utils/amx.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/utils
copying python/utils/init.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/utils
copying python/utils/llamafile.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/utils
copying python/utils/moe_kernel.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/utils
creating build/lib.linux-x86_64-cpython-312/kt_kernel/cli
copying python/cli/main.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli
copying python/cli/i18n.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli
copying python/cli/init.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli
creating build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
copying python/cli/commands/bench.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
copying python/cli/commands/version.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
copying python/cli/commands/config.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
copying python/cli/commands/doctor.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
copying python/cli/commands/run.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
copying python/cli/commands/init.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
copying python/cli/commands/chat.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
copying python/cli/commands/quant.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
copying python/cli/commands/model.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
copying python/cli/commands/sft.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/commands
creating build/lib.linux-x86_64-cpython-312/kt_kernel/cli/config
copying python/cli/config/init.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/config
copying python/cli/config/settings.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/config
creating build/lib.linux-x86_64-cpython-312/kt_kernel/cli/utils
copying python/cli/utils/init.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/utils
copying python/cli/utils/environment.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/utils
copying python/cli/utils/model_registry.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/utils
copying python/cli/utils/sglang_checker.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/utils
copying python/cli/utils/console.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/utils
creating build/lib.linux-x86_64-cpython-312/kt_kernel/cli/completions
copying python/cli/completions/init.py -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/completions
running egg_info
writing kt_kernel.egg-info/PKG-INFO
writing dependency_links to kt_kernel.egg-info/dependency_links.txt
writing entry points to kt_kernel.egg-info/entry_points.txt
writing requirements to kt_kernel.egg-info/requires.txt
writing top-level names to kt_kernel.egg-info/top_level.txt
reading manifest file 'kt_kernel.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'LICENSE'
warning: no files found matching '.in' under directory 'cmake'
warning: no files found matching '.hpp' under directory 'cpu_backend'
warning: no files found matching '.c' under directory 'cpu_backend'
warning: no files found matching '.cc' under directory 'cpu_backend'
warning: no files found matching '.c' under directory 'operators'
warning: no files found matching '.cc' under directory 'operators'
warning: no previously-included files matching '.pyc' found anywhere in distribution
warning: no previously-included files matching '.pyo' found anywhere in distribution
warning: no previously-included files matching 'pycache' found anywhere in distribution
warning: no previously-included files matching '.git' found anywhere in distribution
warning: no previously-included files matching '.so' found anywhere in distribution
warning: no previously-included files matching '.o' found anywhere in distribution
warning: no previously-included files matching '.a' found anywhere in distribution
warning: no previously-included files matching 'build' found anywhere in distribution
warning: no previously-included files matching 'dist' found anywhere in distribution
warning: no previously-included files matching '.egg-info' found anywhere in distribution
writing manifest file 'kt_kernel.egg-info/SOURCES.txt'
copying python/cli/completions/_kt -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/completions
copying python/cli/completions/kt-completion.bash -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/completions
copying python/cli/completions/kt.fish -> build/lib.linux-x86_64-cpython-312/kt_kernel/cli/completions
running build_ext
-- Detected git worktree at /home/sitonholy/Documents/ktransformers; installing hooks from kt-kernel/.githooks
-- Found OpenMP_C: -fopenmp (found version "4.5")
-- Found OpenMP_CXX: -fopenmp (found version "4.5")
-- CMAKE_CXX_FLAGS: -O3 -ffast-math
-- CMAKE_SYSTEM_PROCESSOR: x86_64
-- x86 detected
-- AVX512 extensions: F=ON, BF16=OFF, VNNI=ON, VBMI=ON
-- ARCH_FLAGS: -mfma;-mavx;-mavx2;-march=native;-mavx512f;-mavx512bw;-mavx512dq;-mfma;-mf16c;-msse3;-mavx512vbmi;-mavx512vnni;-mf16c
CMake Deprecation Warning at /home/sitonholy/Documents/ktransformers/third_party/pybind11/CMakeLists.txt:13 (cmake_minimum_required):
Compatibility with CMake < 3.10 will be removed from a future version of
CMake.
-- pybind11 v2.14.0 dev1
-- Found OpenMP_C: -fopenmp (found version "4.5")
-- Found OpenMP_CXX: -fopenmp (found version "4.5")
-- OpenMP found
-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with LLAMA_CCACHE=OFF
-- CMAKE_SYSTEM_PROCESSOR: x86_64
-- x86 detected
-- CUDA detected
-- enabling CUDA
-- CUDA architectures (user): 80;86;89;90
-- CUDA compiler: /usr/local/cuda-12.8/bin/nvcc
-- CUDA toolkit: 12.8.61
-- CUDA flags: -O3 --use_fast_math --expt-relaxed-constexpr
-- SOURCE_DIR7:
CMake Warning at CMakeLists.txt:527 (message):
ONLY for developer: clang-format not found. Please install clang-format
(>=18) or pass -DCLANG_FORMAT_BIN=/full/path and reconfigure.
-- LTO: disabled
-- CUDA runtime: static (/usr/local/cuda-12.8/targets/x86_64-linux/lib/libcudart_static.a)
-- NUMA library found: /usr/lib/x86_64-linux-gnu/libnuma.a - enabling NUMA support
-- Configuring done (0.3s)
-- Generating done (0.0s)
-- Build files have been written to: /home/sitonholy/Documents/ktransformers/kt-kernel
Error: not a CMake build directory (missing CMakeCache.txt)
-- CPUINFER_USE_CUDA not set; auto-detected CUDA toolkit: YES
Detected CPU info: {'vendor': 'intel', 'arch': 'x86_64', 'features': {'AVX512_VBMI', 'AVX512_VPOPCNTDQ', 'AVX512', 'AVX2', 'AVX512_VNNI'}, 'raw': {'flags': {'pclmulqdq', 'ssse3', 'art', 'bmi1', 'cmov', 'sse4_2', 'pebs', 'rdpid', 'clwb', 'tsc', 'avx512_vnni', 'vpid', 'cqm_mbm_total', 'tsc_deadline_timer', 'arch_perfmon', 'avx', 'fsgsbase', 'cpuid_fault', 'cx8', 'pln', 'avx512_vbmi2', 'xsaves', 'sse', 'pdcm', 'pdpe1gb', 'mca', 'invpcid', 'cqm', 'split_lock_detect', 'invpcid_single', 'smep', 'pku', 'erms', 'nonstop_tsc', 'rdrand', 'mba', 'intel_pt', 'pat', 'dts', 'ept_ad', 'ept', 'pae', 'ospke', 'de', 'rdtscp', 'cpuid', 'intel_ppin', 'mmx', 'cat_l3', 'avx512f', 'fpu', 'bts', 'arch_capabilities', 'rep_good', 'tsc_adjust', 'xgetbv1', 'abm', 'dtes64', 'ibrs', 'sep', 'acpi', 'fxsr', 'vnmi', 'aes', 'adx', 'lm', 'tme', 'epb', 'flush_l1d', 'ss', 'md_clear', '3dnowprefetch', 'dtherm', 'avx512dq', 'popcnt', 'aperfmperf', 'avx512_vpopcntdq', 'mce', 'lahf_lm', 'xsaveopt', 'cqm_llc', 'tpr_shadow', 'est', 'tm2', 'vaes', 'mtrr', 'pni', 'nx', 'gfni', 'smap', 'syscall', 'avx512_bitalg', 'nopl', 'avx512bw', 'pcid', 'pse', 'stibp', 'ssbd', 'arat', 'ibrs_enhanced', 'umip', 'xsave', 'vmx', 'avx2', 'pse36', 'flexpriority', 'avx512vbmi', 'sdbg', 'la57', 'rdseed', 'clflush', 'tm', 'dca', 'ds_cpl', 'clflushopt', 'f16c', 'avx512vl', 'fsrm', 'fma', 'cx16', 'x2apic', 'cqm_occup_llc', 'vpclmulqdq', 'smx', 'sha_ni', 'constant_tsc', 'wbnoinvd', 'bmi2', 'ida', 'pbe', 'xtpr', 'apic', 'vme', 'rdt_a', 'cqm_mbm_local', 'avx512ifma', 'xsavec', 'sse2', 'ht', 'avx512cd', 'movbe', 'pge', 'ibpb', 'sse4_1', 'pts', 'msr', 'pconfig', 'xtopology'}}}
-- Forward CPUINFER_ENABLE_AMX -> -DKTRANSFORMERS_CPU_USE_AMX=OFF
-- Enabling AMX/AVX512 umbrella (-DKTRANSFORMERS_CPU_USE_AMX_AVX512=ON)
-- Forward CPUINFER_ENABLE_AVX512_VNNI -> -DLLAMA_AVX512_VNNI=ON
-- Forward CPUINFER_ENABLE_AVX512_BF16 -> -DLLAMA_AVX512_BF16=OFF
-- Forward CPUINFER_ENABLE_AVX512_VBMI -> -DLLAMA_AVX512_VBMI=ON
-- AVX512 extensions enabled; also enabling base AVX512F (-DLLAMA_AVX512=ON)
-- CPU detection: vendor=intel arch=x86_64 features=['AVX2', 'AVX512', 'AVX512_VBMI', 'AVX512_VNNI', 'AVX512_VPOPCNTDQ']
-- Enabling CUDA backend (-DKTRANSFORMERS_USE_CUDA=ON)
-- Auto-detected nvcc: /usr/local/cuda-12.8/bin/nvcc (adding -DCMAKE_CUDA_COMPILER)
-- Set CUDA architectures: 80;86;89;90
-- CMake configure args:
-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/sitonholy/Documents/ktransformers/kt-kernel/build/lib.linux-x86_64-cpython-312/kt_kernel/
-DPYTHON_EXECUTABLE=/home/sitonholy/miniconda3/envs/kt-kernel/bin/python3
-DCMAKE_BUILD_TYPE=Release
-DLLAMA_NATIVE=ON
-DKTRANSFORMERS_CPU_USE_AMX=OFF
-DKTRANSFORMERS_CPU_USE_AMX_AVX512=ON
-DLLAMA_AVX512_VNNI=ON
-DLLAMA_AVX512_BF16=OFF
-DLLAMA_AVX512_VBMI=ON
-DLLAMA_AVX512=ON
-DKTRANSFORMERS_USE_CUDA=ON
-DCMAKE_CUDA_COMPILER=/usr/local/cuda-12.8/bin/nvcc
-DCMAKE_CUDA_ARCHITECTURES=80;86;89;90
-- CMake build args: --build . --config Release --parallel 48
Traceback (most recent call last):
File "/home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in
main()
File "/home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
json_out["return_val"] = hook(**hook_input["kwargs"])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel
return _build_backend().build_wheel(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 439, in build_wheel
return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 427, in _build
return self._build_with_temp_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 408, in _build_with_temp_dir
self.run_setup()
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 317, in run_setup
exec(code, locals())
File "", line 723, in
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/init.py", line 117, in setup
return distutils.core.setup(**attrs) # type: ignore[return-value]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
dist.run_commands()
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
self.run_command(cmd)
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/dist.py", line 1107, in run_command
super().run_command(command)
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
cmd_obj.run()
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py", line 370, in run
self.run_command("build")
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
self.distribution.run_command(command)
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/dist.py", line 1107, in run_command
super().run_command(command)
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
cmd_obj.run()
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
self.distribution.run_command(command)
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/dist.py", line 1107, in run_command
super().run_command(command)
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
cmd_obj.run()
File "", line 150, in run
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 97, in run
_build_ext.run(self)
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
self.build_extensions()
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 484, in build_extensions
self._build_extensions_serial()
File "/tmp/pip-build-env-7g91tvhj/overlay/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 510, in _build_extensions_serial
self.build_extension(ext)
File "", line 256, in build_extension
File "", line 439, in _build_single_variant
File "", line 672, in _build_single_variant_impl
File "/home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--config', 'Release', '--parallel', '48']' returned non-zero exit status 1.
error: subprocess-exited-with-error
× Building wheel for kt-kernel (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> No available output.
note: This error originates from a subprocess, and is likely not a problem with pip.
full command: /home/sitonholy/miniconda3/envs/kt-kernel/bin/python3 /home/sitonholy/miniconda3/envs/kt-kernel/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmpvckwav0h
cwd: /home/sitonholy/Documents/ktransformers/kt-kernel
Building wheel for kt-kernel (pyproject.toml) ... error
ERROR: Failed building wheel for kt-kernel
Failed to build kt-kernel
error: failed-wheel-build-for-install
× Failed to build installable wheels for some pyproject.toml based projects
╰─> kt-kernel
Others
No response
@SkqLiao commented on GitHub (Feb 5, 2026):
Have you run
git submodule update --init --recursivebefore installing kt-kernel?This looks like a CMake configuration issue possibly caused by missing submodules. Unfortunately, the current log doesn’t contain enough information to investigate further. Could you please provide the full CMake error output (or rerun with verbose logging enabled)?
@PlantBiTree commented on GitHub (Feb 27, 2026):
我也遇到了这个问题，我重新找到了
github.com/kvcache-ai/ktransformers@20262b2743/doc/en/install.md这个页面按照步骤来了一遍，后面就正常了
part2：随后我又继续安装了sglang,我不确定是不是因为网络问题导致的下载失败等问题，kt-kernel安装成功时和刚开始安装已经差了8个小时左右
@SkqLiao commented on GitHub (Feb 27, 2026):
Thank you for the feedback. With a stable network connection (specifically for accessing GitHub), the installation should complete within a few minutes. The majority of the time is spent on
git submodule update --init --recursiveand thecmakebuild process.@ErvinXie commented on GitHub (Feb 28, 2026):
已有解决方案（
git submodule update --init --recursive），关闭。@PlantBiTree commented on GitHub (Mar 1, 2026):
补充一下，直接通过git submodule update --init --recursive 好像并不能直接解决此问题，Close动作可能过于仓促
完成kt-kernel的安装后，下一步需要进行sglang的安装，同样的，普通安装方式可能会因为网络问题导致安装失败。
因此我更换为uv安装，随后在uv安装过程中出现以下错误
----------报错部分----------
pip install uv
Collecting uv
Downloading uv-0.10.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Downloading uv-0.10.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (23.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23.2/23.2 MB 138.6 kB/s 0:02:22
Installing collected packages: uv
Successfully installed uv-0.10.7
(kt-kernel) uniserver@com3:~/sglang$ uv pip install -e "python"
Using Python 3.11.14 environment at: /home/uniserver/anaconda3/envs/kt-kernel
Resolved 164 packages in 4m 07s
Built sglang @ file:///home/uniserver/sglang/python
× Failed to download
torch==2.9.1├─▶ Failed to write to the distribution cache
├─▶ error decoding response body
├─▶ request or response body error
├─▶ error reading a body from connection
╰─▶ connection reset
help:
torch(v2.9.1) was included becausesglang(v0.0.0.dev10190+g48b12817a) depends ontorch----------报错部分----------
我个人推测可能是网络问题导致的uv安装失败，因此我尝试将uv换源操作，将uv源换为清华源
git clone https://github.com/kvcache-ai/sglang.git
cd sglang
pip install --upgrade pip
pip install uv
export UV_DEFAULT_INDEX="https://pypi.tuna.tsinghua.edu.cn/simple"
source ~/.bashrc
uv pip install -e "python"
等待全部安装完成后检测安装情况
python -c "import sglang; print(sglang.version)"
输出：0.0.0.dev10190+g48b12817a
后续将继续尝试其他安装步骤
@SkqLiao commented on GitHub (Mar 1, 2026):
Connectivity issues with GitHub are beyond our control and are not related to the project's code. Users are expected to resolve such environment-specific issues independently (e.g., by setting up a proxy).