turboderp b25210778c Remove fasttensors, add platform-agnostic multithreaded ST loader

2024-09-17 00:33:16 +02:00

..

compare_quants.py

Add more datasets

2024-04-30 20:38:26 +02:00

test_alloc.py

34B testing

2023-09-10 06:15:33 +02:00

test_autosplit.py

Fix unhandled OoM condition when loading GPTQ model with auto split

2023-10-28 20:08:39 +02:00

test_batch_latency.py

Batch latency test script

2023-12-23 22:04:40 +01:00

test_gemv.py

Instrumentation etc.

2023-12-10 17:36:40 +01:00

test_hgemm.py

Tests for half GEMM kernels

2023-11-25 11:54:53 +01:00

test_stloader.py

Remove fasttensors, add platform-agnostic multithreaded ST loader

2024-09-17 00:33:16 +02:00

test_tokenizer.py

Fix some tokenization edge cases

2023-12-03 22:03:23 +01:00

test.py

Optimizer batched sampling

2023-12-23 22:04:10 +01:00