kvcache-ai/custom_flashinfer
1
0
Fork 0
mirror of https://github.com/kvcache-ai/custom_flashinfer.git synced 2026-06-29 02:37:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,224 Commits 11 Branches 0 Tags

Default Branch

main

18fd91a74a · bugfix: Fix the bug of the kernel-selection heuristic in trtllm-gen (#1307) · Updated 2025-07-23 08:33:23 +00:00
 ZIP  TAR.GZ

Branches

AOT

ac74c5104a · 0611,merge upstream, support aot · Updated 2025-06-11 12:56:22 +00:00    kvcache-ai

97
23
 ZIP  TAR.GZ
change_dir

6dc5d5661c · update flashinfer cache ops dir · Updated 2025-05-21 12:06:36 +00:00    kvcache-ai

195
22
 ZIP  TAR.GZ
MLA_cache_var_batch

9187ac8318 · add nnz_tensor to mla cache · Updated 2025-05-17 09:33:11 +00:00    kvcache-ai

195
21
 ZIP  TAR.GZ
GQA_var_batch

a3ebdf890f · fix bug when large batch · Updated 2025-04-28 16:16:35 +00:00    kvcache-ai

195
20
 ZIP  TAR.GZ
batchprefill_varlen

fdf1725f9f · [update] fix bug · Updated 2025-03-31 13:59:14 +00:00    kvcache-ai

238
6
 ZIP  TAR.GZ
fix-precision-mla-merge-main

fd94393fb5 · clean up · Updated 2025-03-28 10:43:19 +00:00    kvcache-ai

195
17
 ZIP  TAR.GZ
cuda_graph_wjh

a7a2c5f08f · 1e4 · Updated 2025-02-11 03:06:11 +00:00    kvcache-ai

415
18
 ZIP  TAR.GZ
optimize-mask

ebf84de346 · tmp · Updated 2025-02-07 08:34:24 +00:00    kvcache-ai

415
17
 ZIP  TAR.GZ
rope-wjh

c1b2bbfd4c · rope success · Updated 2025-01-02 09:06:44 +00:00    kvcache-ai

415
15
 ZIP  TAR.GZ
feat-cuda_graph_var_batch-zbx

0a73be7131 · update setup.py, don't remove data_dir · Updated 2024-12-17 03:42:54 +00:00    kvcache-ai

415
12
 ZIP  TAR.GZ