Johnny b5493f65be [NVIDIA] upstream FA4 (#15182) ...

Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

2026-01-11 15:31:28 +08:00

..

quantization

[7/n] decouple quantization impl from vllm dependency - gguf kernel (#11019)

2025-10-11 14:04:57 -07:00

testing

[1/2] Add rope kernel in sgl-kernel (#14334)

2025-12-04 16:45:44 +08:00

__init__.py

[diffusion] kernel: timestep embedding kernel implementation (#12995)

2025-12-19 20:59:50 +08:00

_fa4_interface.py

[NVIDIA] upstream FA4 (#15182)

2026-01-11 15:31:28 +08:00

allreduce.py

[amd] Add deterministic all-reduce kernel for AMD (ROCm) (#15340)

2025-12-18 23:36:03 -08:00

attention.py

[sgl-kernel Code Clean] Remove useless lightning_attention kernel (#13819)

2025-11-24 18:26:25 +08:00

cutlass_moe.py

[1/n]: add cutlass W4A8 moe kernel for hopper architecture (#7772)

2025-07-04 20:50:12 -07:00

elementwise.py

[diffusion] kernel: timestep embedding kernel implementation (#12995)

2025-12-19 20:59:50 +08:00

expert_specialization.py

[sgl-kernel][Feat][B200][1/N] Support MXFP8 Grouped GEMM in Blackwell (#13731)

2025-12-04 10:09:09 +08:00

flash_attn.py

[NVIDIA] upstream FA4 (#15182)

2026-01-11 15:31:28 +08:00

flash_mla.py

[sgl-kernel] support custom fp8 flashmla kernel (#13087)

2025-11-13 12:45:21 -08:00

fused_moe.py

Add new moe wna16 marlin gemm (#14122)

2025-12-01 23:07:53 +08:00

gemm.py

move all get_stream in sgl_kernel to c++ to reduce the launch overhead (#12521)

2025-11-02 13:15:05 -08:00

grammar.py

fix sgl-kernel unit tests (#5666)

2025-04-23 01:18:30 -07:00

hadamard.py

[sgl-kernel] support hadamard (#11663)

2025-10-15 19:00:44 -07:00

kvcacheio.py

[HiCache]Page head layout IO kernel (#11615)

2025-10-26 15:53:50 +08:00

load_utils.py

[sgl-kernel] fix runtime error while preloading CUDA runtime (#13089)

2025-12-02 23:03:51 +08:00

mamba.py

Add mamba kernel (#10234)

2025-09-09 12:58:43 -07:00

marlin.py

[2/n]decouple quantization implementation from vLLM dependency (#8112)

2025-08-14 03:19:03 -07:00

memory.py

[1 / 2] register weak_ref_tensor in sgl-kernel (#12999)

2025-11-10 22:12:59 +08:00

moe.py

[sgl-kernel][1/2] Fused qk_norm_rope for GLM4.6 (#15141)

2025-12-18 17:07:04 +08:00

sampling.py

Minor style fixes for sgl-kernel (#9289)

2025-08-18 09:38:35 -07:00

scalar_type.py

refactor: Move scalar_types.py to sgl-kernel to avoid circular import (#8720)

2025-08-07 19:22:16 -07:00

sparse_flash_attn.py

[Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847)

2025-04-28 11:03:17 -07:00

spatial.py

Optional extension for green context (#9231)

2025-08-15 21:33:52 +08:00

speculative.py

move all get_stream in sgl_kernel to c++ to reduce the launch overhead (#12521)

2025-11-02 13:15:05 -08:00

test_utils.py

Reland [1/2] Optimizations and refactors about quant kernel (#10312)

2025-10-11 15:59:03 +08:00

top_k.py

[sgl-kernel][Deepseek V3.2] Add row_starts to topk kernel (#12582)

2025-11-07 18:33:27 -08:00

utils.py

move all get_stream in sgl_kernel to c++ to reduce the launch overhead (#12521)

2025-11-02 13:15:05 -08:00

version.py

chore: bump sgl-kernel version to 0.3.20 (#15564)

2025-12-21 13:15:23 -08:00