SijiaYang da3890e82a [1/n]: add cutlass W4A8 moe kernel for hopper architecture (#7772) ...

Signed-off-by: yangsijia.614 <yangsijia.614@bytedance.com>
Co-authored-by: yicwang <yichen.wang@bytedance.com>

2025-07-04 20:50:12 -07:00

..

__init__.py

[1/n]: add cutlass W4A8 moe kernel for hopper architecture (#7772)

2025-07-04 20:50:12 -07:00

allreduce.py

support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277)

2025-06-04 22:11:24 -07:00

attention.py

[fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184)

2025-06-14 12:45:41 -07:00

cutlass_moe.py

[1/n]: add cutlass W4A8 moe kernel for hopper architecture (#7772)

2025-07-04 20:50:12 -07:00

elementwise.py

[Feat] Enable PDL automatically on Hopper architecture (#5981)

2025-06-01 12:30:17 -07:00

flash_attn.py

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

fused_moe.py

[1/n] apply wna16marlin kernel in moe weight only quantization (#7683)

2025-07-01 23:21:25 -07:00

gemm.py

Add dsv3 router gemm kernel (#7627)

2025-06-29 23:31:55 -07:00

grammar.py

fix sgl-kernel unit tests (#5666)

2025-04-23 01:18:30 -07:00

kvcacheio.py

kvcache io kernels and test case (#7382)

2025-06-23 11:58:59 -07:00

marlin.py

[1/n] apply wna16marlin kernel in moe weight only quantization (#7683)

2025-07-01 23:21:25 -07:00

moe.py

[optimize] fuse renormalize into moe_topk_softmax (#7744)

2025-07-03 12:42:44 -07:00

sampling.py

Fix a bug in BatchTokenIDOut & Misc style and dependency updates (#7457)

2025-06-23 06:20:39 -07:00

scalar_type.py

[1/n] apply wna16marlin kernel in moe weight only quantization (#7683)

2025-07-01 23:21:25 -07:00

sparse_flash_attn.py

[Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847)

2025-04-28 11:03:17 -07:00

speculative.py

Fix sampling for speculative decoding & simplify kernels (#7207)

2025-06-16 03:28:30 -07:00

top_k.py

Fix sampling for speculative decoding & simplify kernels (#7207)

2025-06-16 03:28:30 -07:00

utils.py

misc: cache is_hopper_arch (#6799)

2025-06-01 15:28:31 -07:00

version.py

chore: bump sgl-kernel 0.2.2 (#7755)

2025-07-03 12:49:10 -07:00