Sinan 7c7b1993b4 Added draft token count as parameter to chat.py (#635)

2024-09-24 11:16:30 +02:00

..

deprecated

Fix deprecated example

2024-06-02 12:53:50 +02:00

bulk_inference.py

Bulk example: Compute immediate output tokens/second

2024-08-22 12:46:58 +02:00

chat_example.ipynb

Update colab example

2024-03-13 08:24:23 +01:00

chat_formatting.py

Fixed padding issue

2023-11-29 01:43:20 +01:00

chat_prompts.py

Chatbot: fix chatml template

2024-07-03 22:34:46 +02:00

chat.py

Added draft token count as parameter to chat.py (#635)

2024-09-24 11:16:30 +02:00

dynamic_gen.py

Update examples

2024-07-09 07:33:19 +02:00

inference_async.py

Update examples

2024-07-09 07:33:19 +02:00

inference_banned_strings.py

Update examples

2024-07-09 07:33:19 +02:00

inference_cfg.py

Update examples

2024-07-09 07:33:19 +02:00

inference_dedup.py

Update examples

2024-07-09 07:33:19 +02:00

inference_json_lmfe_wrapper.py

Fix JSON inference example

2024-09-14 21:35:02 +02:00

inference_json.py

Fix JSON inference example

2024-09-14 21:35:02 +02:00

inference_lora.py

Update examples

2024-07-09 07:33:19 +02:00

inference_speculative.py

Update examples

2024-07-09 07:33:19 +02:00

inference_stream.py

Update examples

2024-07-09 07:33:19 +02:00

inference_tp.py

Update TP example

2024-08-22 13:43:19 +02:00

inference.py

Update examples

2024-07-09 07:33:19 +02:00

minimal_chat.py

Update examples

2024-05-22 22:22:06 +02:00

the_black_veil.utf8

Add dedup example

2024-05-25 03:08:40 +02:00

util.py

Example Gemma template

2024-07-04 05:25:12 +02:00

ws_server.py

A little cleanup

2024-05-18 06:39:26 +02:00