turboderp eb2cae6c52 Add auto GPU split feature

2023-10-22 18:48:35 +02:00

..

test_alloc.py

34B testing

2023-09-10 06:15:33 +02:00

test_autosplit.py

Add auto GPU split feature

2023-10-22 18:48:35 +02:00

test_gemv.py

Optimization, wider loads in EXL2 kernel (int4)

2023-09-07 10:56:43 +02:00

test_mmlu.py

Add typical setting to chat example.

2023-09-26 19:50:44 +02:00

test.py

Test script

2023-10-15 22:58:19 +02:00