Add vision support in llama-server (#901)

Browse Source

* server: add support for vision model
webui: add support for vision model

* server : remove hack for extra parallel slot#10187

* llama : fix KV shift for qwen2vl #13870

* add no-context-shift parameter

---------

Co-authored-by: firecoperana <firecoperana>

...

This commit is contained in:

firecoperana

2025-11-05 08:43:46 +00:00

committed by GitHub

parent 5b38d431ac

commit 15159a87d4

26 changed files with 2456 additions and 729 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

748

examples/server/server.cpp

File diff suppressed because it is too large Load Diff