turboderp 093b89d38c Add generator versions of model.load() and model.load_autosplit()

2023-10-23 01:17:10 +02:00

..

test_alloc.py

34B testing

2023-09-10 06:15:33 +02:00

test_autosplit.py

Add generator versions of model.load() and model.load_autosplit()

2023-10-23 01:17:10 +02:00

test_gemv.py

Make sure all inference is done in torch.inference_mode()

2023-10-22 20:23:42 +02:00

test_mmlu.py

Add typical setting to chat example.

2023-09-26 19:50:44 +02:00

test.py

Test script

2023-10-15 22:58:19 +02:00