Zihao Ye 8daa44f309 comm: refactor and initialize flashinfer.comm module (#1089)

2025-05-24 09:37:39 -07:00

..

bench_batch_decode_mla.cu

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00

bench_batch_decode.cu

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00

bench_batch_prefill.cu

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00

bench_cascade.cu

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00

bench_norm.cu

bench: add sampling & norm benchmarks (#208)

2024-04-22 19:26:54 -07:00

bench_sampling.cu

feat: more sampling operator options (#431)

2024-08-08 23:05:31 -07:00

bench_single_decode.cu

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00

bench_single_prefill.cu

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00

cpu_reference.h

perf: accelerate JIT compilation speed (#618)

2024-11-20 00:40:21 -08:00

flashinfer_ops.cuh

add multi-item scoring (#1015)

2025-04-30 11:49:55 -07:00

test_batch_decode.cu

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00

test_batch_prefill.cu

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00

test_cascade.cu

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00

test_fast_dequant.cu

perf: faster fp8->fp16 dequantization for pre sm_90 arch (#439)

2024-08-10 21:29:53 -07:00

test_fastdiv.cu

misc: suppress compilation warning of fastdiv (#279)

2024-06-02 12:00:17 -07:00

test_norm.cu

sampling: fix alignment issue for vocab_size not divisible by vec_size (#211)

2024-04-24 14:42:01 -07:00

test_page.cu

misc: Finer-grained control over fp16/fp8 builds (#722)

2025-01-07 23:41:11 -08:00

test_sampling.cu

ci: setup pre-commit (#584)

2024-11-04 23:56:16 -08:00

test_single_decode.cu

misc: Finer-grained control over fp16/fp8 builds (#722)

2025-01-07 23:41:11 -08:00

test_single_prefill.cu

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00

utils.h

[Refactor] Unify JIT/Customization/AOT mode (#748)

2025-01-23 04:09:13 -05:00