turboderp 2a888dbd47 Pixtral example

2024-11-12 03:46:29 +01:00

..

deprecated

Fix deprecated example

2024-06-02 12:53:50 +02:00

bulk_inference.py

Bulk example: Compute immediate output tokens/second

2024-08-22 12:46:58 +02:00

chat_example.ipynb

Update colab example

2024-03-13 08:24:23 +01:00

chat_formatting.py

Fixed padding issue

2023-11-29 01:43:20 +01:00

chat_prompts.py

Chatbot: fix chatml template

2024-07-03 22:34:46 +02:00

chat.py

Fix regressions

2024-11-10 13:38:21 +01:00

dynamic_gen.py

Update examples

2024-07-09 07:33:19 +02:00

inference_async.py

Update examples

2024-07-09 07:33:19 +02:00

inference_banned_strings.py

Update examples

2024-07-09 07:33:19 +02:00

inference_cfg.py

Update examples

2024-07-09 07:33:19 +02:00

inference_dedup.py

Update examples

2024-07-09 07:33:19 +02:00

inference_formatron.py

Update Formatron example (supports conlist since 0.4.6)

2024-10-15 19:28:00 +02:00

inference_lmfe_wrapper.py

Rename JSON example

2024-10-02 23:59:53 +02:00

inference_lmfe.py

Rename JSON example

2024-10-02 23:59:53 +02:00

inference_lora.py

Update examples

2024-07-09 07:33:19 +02:00

inference_speculative.py

Update examples

2024-07-09 07:33:19 +02:00

inference_stream.py

Update examples

2024-07-09 07:33:19 +02:00

inference_tp.py

Update TP example

2024-08-22 13:43:19 +02:00

inference.py

Update examples

2024-07-09 07:33:19 +02:00

minimal_chat.py

Update examples

2024-05-22 22:22:06 +02:00

multimodal_pixtral.py

Pixtral example

2024-11-12 03:46:29 +01:00

test_image_1.jpg

Pixtral example

2024-11-12 03:46:29 +01:00

test_image_2.jpg

Pixtral example

2024-11-12 03:46:29 +01:00

the_black_veil.utf8

Add dedup example

2024-05-25 03:08:40 +02:00

util.py

Example Gemma template

2024-07-04 05:25:12 +02:00

ws_server.py

A little cleanup

2024-05-18 06:39:26 +02:00