turboderp c8e2bf4594 Fix small mistake in example

2024-02-19 14:20:17 +01:00

..

batched_inference.py

Cleanup examples a bit

2024-01-20 10:57:16 +01:00

cfg.py

CFG support in streaming gen

2024-01-01 23:48:24 +01:00

chat_example.ipynb

Add files via upload

2023-11-23 16:02:50 +01:00

chat_formatting.py

Fixed padding issue

2023-11-29 01:43:20 +01:00

chat_prompts.py

Add nous prompt format

2024-01-19 16:45:37 +01:00

chat.py

More typeable arg shortcut

2024-02-02 15:03:16 +01:00

inference.py

Cleanup examples a bit

2024-01-20 10:57:16 +01:00

lm_format_enforcer.py

Fix small mistake in example

2024-02-19 14:20:17 +01:00

lora.py

Remove return values from load_gen

2024-02-14 19:41:59 +01:00

minimal_chat.py

Add minimal chat example

2023-12-31 03:40:56 +01:00

multiple_caches.py

Fix multiple caches not working with 8-bit cache mode

2023-12-17 14:41:21 +01:00

speculative.py

Slight tweaks to SD

2023-12-25 16:54:13 +01:00

streaming.py

Merge branch 'pr-238'

2024-01-20 13:14:21 +01:00

ws_server.py

Update examples (auto GPU split)

2023-10-22 19:32:26 +02:00