Yuhao Yang 5595f6e988 Fix trtllm mla chunked-prefill zero-length bug (#22291) (#22688)

2026-04-20 22:10:13 -07:00

..

benchmark

[Feature][JIT Kernel] Fused TP QK norm For Minimax (#20673)

2026-04-13 20:29:47 +08:00

csrc

Fix trtllm mla chunked-prefill zero-length bug (#22291) (#22688)

2026-04-20 22:10:13 -07:00

diffusion

diffusion: add HunyuanVideo GroupNorm+SiLU fast path (#22814)

2026-04-18 23:38:49 +08:00

include/sgl_kernel

[Feature][JIT Kernel] Fused TP QK norm For Minimax (#20673)

2026-04-13 20:29:47 +08:00

tests

[misc] CI hygiene: enforce __main__ entry, drop silent-skipped tests, fix rerun-test protoc (#23305)

2026-04-20 21:16:24 -07:00

triton

[Qwen3.5] Fuse split/reshape/cat ops in GDN projection with Triton kernel (#21019)

2026-03-23 23:17:01 +08:00

__init__.py

Move fa4 from sgl-kernel to jit kernel (#17353)

2026-01-24 15:25:03 +08:00

__main__.py

[Chore] Clean up JIT compilation flags (#21022)

2026-03-25 18:08:40 +08:00

.clang-format

[JIT Kernel][Feature] Support JIT custom all reduce (rewrite as v2) (#19880)

2026-03-20 18:24:07 +08:00

add_constant.py

[1/n jit_kernel restruct] unify cache usage and clean up naming in ngram_embedding (#20244)

2026-03-10 15:53:43 +08:00

all_reduce.py

[Feature][JIT Kernel] Fused TP QK norm For Minimax (#20673)

2026-04-13 20:29:47 +08:00

awq_dequantize.py

[Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949)

2026-02-23 22:05:27 +08:00

awq_marlin_repack.py

[misc] clean up kernel API (#21325)

2026-03-25 09:10:23 +08:00

cast.py

[jit_kernel] Migrate cast (downcast_fp8) from sgl-kernel AOT to JIT (#19103)

2026-03-27 13:21:44 +08:00

clamp_position.py

Replace clamp_position with JIT kernel + platform dispatch (#20999)

2026-03-21 21:26:26 -07:00

concat_mla.py

[Move sgl-kernel Kernel to JIT] Add JIT concat MLA kernels (#17889)

2026-02-03 10:49:17 +08:00

cutedsl_gdn.py

[jit-kernel] Add CuTe DSL GDN Decode Kernel (#15631)

2026-01-18 12:54:36 -08:00

cutedsl_kda.py

[KDA] Support CuTeDSL KDA decode kernel (#21203)

2026-03-25 09:47:09 +08:00

fixup_zero_kv.py

Fix trtllm mla chunked-prefill zero-length bug (#22291) (#22688)

2026-04-20 22:10:13 -07:00

flash_attention_v3.py

[AMD] Fix multimodal diffusion test crash on ROCm by falling back to SDPA (#22335)

2026-04-08 22:32:49 -07:00

flash_attention_v4.py

Kernels community fa3 (#20796)

2026-04-07 12:48:44 -07:00

flash_attention.py

Lazy import flash_attention_v4 to avoid loading flash_attn.cute at startup (#22306)

2026-04-08 20:40:25 -07:00

fused_metadata_copy.py

Kernel: optimize decoding metadata in NSA multi-spec backend with fused kernels (#17554)

2026-02-14 16:40:15 +08:00

fused_qknorm_rope.py

[jit_kernel] Optimize fused_qknorm_rope: deduplicate sincosf for interleave RoPE (#21654)

2026-04-01 09:04:13 +08:00

fused_store_index_cache.py

[misc] clean up kernel API (#21325)

2026-03-25 09:10:23 +08:00

gptq_marlin_repack.py

[misc] clean up kernel API (#21325)

2026-03-25 09:10:23 +08:00

gptq_marlin.py

[misc] clean up kernel API (#21325)

2026-03-25 09:10:23 +08:00

hadamard.py

refactor(jit_kernel): reduce duplication and separate test code (#19323)

2026-02-26 18:30:49 +08:00

hicache.py

[Hicache & JIT_kernel] Support page first layout & mla jit kernel (#18311)

2026-03-27 08:54:36 -07:00

hisparse.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

kvcache.py

[misc] clean up kernel API (#21325)

2026-03-25 09:10:23 +08:00

moe_align.py

[sgl-kernel] support > 1024 experts in moe_align_block_size kernel (#21610)

2026-04-08 11:45:13 -07:00

moe_lora_align.py

[5/n] Lora support cuda graph (#21647)

2026-04-04 00:31:46 -07:00

moe_wna16_marlin.py

Revert "[Feature] NVFP4 Marlin fallback for non-Blackwell GPUs (SM75+… (#22047)

2026-04-03 13:12:30 -07:00

ngram_corpus.py

[Spec][Ngram] Clean up unused stateless batchMatch (#22487)

2026-04-10 21:52:56 -07:00

ngram_embedding.py

[misc] clean up kernel API (#21325)

2026-03-25 09:10:23 +08:00

norm.py

[Feature] JIT rmsnorm update (with claude) (#21834)

2026-04-01 23:40:00 +08:00

nvfp4.py

[diffusion] quant: add FLUX.1-dev modelopt nvfp4 support (#22672)

2026-04-14 15:00:59 +08:00

per_tensor_quant_fp8.py

[misc] clean up kernel API (#21325)

2026-03-25 09:10:23 +08:00

per_token_group_quant_8bit.py

[misc] clean up kernel API (#21325)

2026-03-25 09:10:23 +08:00

resolve_future_token_ids.py

Replace _resolve_future_token_ids with JIT kernel + platform dispatch (#20976)

2026-03-20 01:47:03 -07:00

rope.py

[misc] clean up kernel API (#21325)

2026-03-25 09:10:23 +08:00

timestep_embedding.py

[misc] clean up kernel API (#21325)

2026-03-25 09:10:23 +08:00

utils.py

[Misc] Add @cache_once to is_arch_support_pdl in jit_kernel (#22724)

2026-04-13 14:42:49 -07:00