Liangsheng Yin 1f2da824dd [Benchmark] Remove re-exports from bench_serving.py (#19130)

2026-02-21 14:30:30 -08:00

..

bench_attention_sink

bench: add attention sink op benchmark, triton and trtllm-gen [B200] (#8932)

2025-08-08 00:16:23 -07:00

bench_in_batch_prefix

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

bench_rope

[VLM] Optimize get_rope_index for GLM4v (#17420)

2026-02-01 18:59:15 +08:00

benchmark_batch

Super tiny update tokenizer benchmark (#16429)

2026-01-05 09:14:52 +08:00

benchmark_vllm_060

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

blog_v0_2

Add a new api configure_logging to allow dumping the requests (#2875)

2025-01-13 14:24:00 -08:00

boolq

[benchmark] Add benchmark scripts for ceval and boolq (#8946)

2025-08-23 15:40:15 +08:00

ceval

fix ceval (#10504)

2025-09-24 02:35:25 +08:00

deepseek_v3

update benchmark README to use --fp8-gemm-backend instead of env var (#15689)

2025-12-23 23:23:31 -08:00

dspy

Organize Benchmark (#381)

2024-05-05 16:14:17 +08:00

fla

update pre-commit config (#18860)

2026-02-16 00:18:31 +08:00

generative_agents

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

gpt_oss

[Fix] Add speculative_draft_model_revision to server_args (#5255)

2025-09-05 19:45:46 +08:00

gsm8k

Enhence gsm8k test (#18791)

2026-02-13 18:08:57 +08:00

hellaswag

Simplify frontend language (#9029)

2025-08-10 10:59:30 -07:00

hf3fs

[hotfix]: Add missing args for 3FS bench_client.py (#14791)

2025-12-14 11:13:19 -10:00

hicache

[Benchmark] Remove re-exports from bench_serving.py (#19130)

2026-02-21 14:30:30 -08:00

json_decode_regex

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

json_jump_forward

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

json_schema

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

kernels

Fix benchmark_sglang_fused_moe_triton.py (#18940)

2026-02-17 17:25:37 -05:00

line_retrieval

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

llava_bench

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

llm_judge

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

long_json_decode

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

lora

[Benchmark] Remove re-exports from bench_serving.py (#19130)

2026-02-21 14:30:30 -08:00

mmlu

Fix MMLU benchmark to auto-download data and resolve path issue (#18486)

2026-02-09 10:40:40 -05:00

mmmu

ministral3 (#14251)

2025-12-04 14:31:26 -08:00

mtbench

[Misc] Auto download question file for benchmark/mtbench (#17019)

2026-01-13 10:34:29 -05:00

multi_chain_reasoning

Bug: fixed multi_chain_reasoning test (#16192)

2026-01-12 09:06:41 -08:00

multi_document_qa

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

multi_turn_chat

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

prefill_only

Add overlap scheduling for embeddings code path (#14032)

2025-12-24 18:24:18 -08:00

react

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

reasoning_benchmark

refactor(benchmark): prevents variable shadowing (#17607)

2026-01-22 17:00:11 -05:00

tip_suggestion

update pre-commit config (#18860)

2026-02-16 00:18:31 +08:00

tree_of_thought_deep

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

tree_of_thought_v0

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00