Yap Sok Ann dcf50d8279 Fix tool call for Qwen3.5 (#1300) ...

* Fix tool call for Qwen3.5

Loosely based on mainline changes from:
* https://github.com/ggml-org/llama.cpp/pull/19635
* https://github.com/ggml-org/llama.cpp/pull/19765

Also need to change the grammar to allow the model to make multiple
tool calls in a row. This was likely broken for Qwen3 Coder prior to
this commit.

* Fix the grammar for the subsequent parameters after the first one

2026-02-23 07:54:56 +01:00

95 KiB

Raw Blame History

View Raw