turboderp 9244003a40 Add support for Mistral 3.1 VLM

2025-04-18 22:47:47 +02:00

..

deprecated

Fix deprecated example

2024-06-02 12:53:50 +02:00

media

Qwen2-VL: Basic video support

2024-12-15 23:32:41 +01:00

bulk_inference.py

Bulk example: Compute immediate output tokens/second

2024-08-22 12:46:58 +02:00

chat_example.ipynb

Update colab example

2024-03-13 08:24:23 +01:00

chat_formatting.py

Fixed padding issue

2023-11-29 01:43:20 +01:00

chat_prompts.py

Add GLM4 architecture

2025-04-15 18:57:29 +02:00

chat.py

Update chat.py, include multi-line input support and context clearing through input (#738)

2025-03-10 15:28:33 +01:00

dynamic_gen.py

Update examples

2024-07-09 07:33:19 +02:00

inference_async.py

Update examples

2024-07-09 07:33:19 +02:00

inference_banned_strings.py

Update examples

2024-07-09 07:33:19 +02:00

inference_cfg.py

Update examples

2024-07-09 07:33:19 +02:00

inference_dedup.py

Update examples

2024-07-09 07:33:19 +02:00

inference_formatron.py

Update Formatron example (supports conlist since 0.4.6)

2024-10-15 19:28:00 +02:00

inference_lmfe_wrapper.py

Rename JSON example

2024-10-02 23:59:53 +02:00

inference_lmfe.py

Rename JSON example

2024-10-02 23:59:53 +02:00

inference_lora.py

Update examples

2024-07-09 07:33:19 +02:00

inference_speculative.py

Update examples

2024-07-09 07:33:19 +02:00

inference_stream.py

Update examples

2024-07-09 07:33:19 +02:00

inference_tp.py

Update TP example

2024-08-22 13:43:19 +02:00

inference.py

Update examples

2024-07-09 07:33:19 +02:00

minimal_chat.py

Update examples

2024-05-22 22:22:06 +02:00

multimodal_grounding_qwen.py

Add Qwen2.5 mode to grounding demo

2025-01-29 22:41:36 +01:00

multimodal_video.py

Fix video example

2024-12-30 02:24:49 +01:00

multimodal.py

Add support for Mistral 3.1 VLM

2025-04-18 22:47:47 +02:00

the_black_veil.utf8

Add dedup example

2024-05-25 03:08:40 +02:00

util.py

Example Gemma template

2024-07-04 05:25:12 +02:00

ws_server.py

A little cleanup

2024-05-18 06:39:26 +02:00