turboderp f259fafda9 Optimization, wider loads in GPTQ kernel (int2)

2023-09-07 03:03:02 +02:00

..

chat.py

Fix bug in 6-bit matrix preproc

2023-09-06 08:47:09 +02:00

inference.py

Optimization, wider loads in GPTQ kernel (int2)

2023-09-07 03:03:02 +02:00

streaming.py

Tidying up

2023-09-02 16:40:57 +02:00