turboderp e7b50fedcb Fix chat example Llama mode (EOS was appended twice)

2023-09-05 14:24:53 +02:00

..

chat.py

Fix chat example Llama mode (EOS was appended twice)

2023-09-05 14:24:53 +02:00

inference.py

Reworking attention, allow for batched inference with independent cache per sequence

2023-09-03 15:56:38 +02:00

streaming.py

Tidying up

2023-09-02 16:40:57 +02:00