Commit Graph

4 Commits

Author SHA1 Message Date
fzyzcjy
249c356331 Super tiny update tokenizer benchmark (#16429) 2026-01-05 09:14:52 +08:00
fzyzcjy
387fad2f74 Tiny add detokenization benchmarks (#16400) 2026-01-04 22:53:38 +08:00
Lifu Huang
6e2da51561 Replace time.time() to time.perf_counter() for benchmarking. (#6178)
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
2025-05-11 14:32:49 -07:00
Sundara Raman Ramachandran
f08154193c Perform Batch Tokenization. (#5141) 2025-04-20 18:10:37 -07:00