Files
sglang/python
usrlocalben 31124d0ae7 fix: kt_ep_wrapper silently fails to import after a2f451315 (#57)
Upstream sglang removed the gptq_marlin* kernels to the JIT system.
- Added to JIT in sglang upstream PR #18543
- Removed from sgl-kernel in sglang upstream PR #19241

At that moment the kt_ep_wrapper should have been updated but was not.

In many cases the trouble is not observed since sgl-kernel is often
installed from (stale) prebuilt wheels. When building from source
however, e.g. for CUDA123/sm120, the produced binary does not have
gptq_marlin_repack and kt_ep_wrapper is not imported.
2026-06-21 14:03:44 +08:00
..