dungquixote42 869b83bc49 Add Unicode allowlist (#1597) ...

* initial commit

* cleanup

* fix whitelist arg parsing and simplify keyword search state

* rename white* to allow*

* add vocab_pieces init function, rename update functions, delete accidentally added file

* delete temporary bias code

* auto-generate fill function with script data inside

* deduplicate allowlist unicode rule parsing

* minor cleanup

* delete unnecessary header

* refactor allowlist to support sequential rule sets via keywords

* add early exit for zero-rules case

* delete accidentally added file

2026-04-10 18:22:57 +02:00

..

build-info.sh

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

check-requirements.sh

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ci-run.sh

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

compare-commits.sh

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

compare-llama-bench.py

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

debug-test.sh

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

fetch_server_test_models.py

Tool calls support from mainline (#723)

2025-09-01 08:38:49 +03:00

gen-authors.sh

license : update copyright notice + add AUTHORS (#6405)

2024-04-09 09:23:19 +03:00

gen-unicode-data.py

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

gen-unicode-script-data.py

Add Unicode allowlist (#1597)

2026-04-10 18:22:57 +02:00

get_hf_chat_template.py

Tool calls support from mainline (#723)

2025-09-01 08:38:49 +03:00

get-flags.mk

build : pass all warning flags to nvcc via -Xcompiler (#5570)

2024-02-18 16:21:52 -05:00

get-hellaswag.sh

build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)

2024-06-13 00:41:52 +01:00

get-pg.sh

scripts : improve get-pg.sh (#4838)

2024-01-09 19:21:13 +02:00

get-wikitext-2.sh

build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)

2024-06-13 00:41:52 +01:00

get-wikitext-103.sh

build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)

2024-06-13 00:41:52 +01:00

get-winogrande.sh

build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)

2024-06-13 00:41:52 +01:00

hf.sh

build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)

2024-06-13 00:41:52 +01:00

install-oneapi.bat

support SYCL backend windows build (#5208)

2024-01-31 08:08:07 +05:30

pod-llama.sh

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

qnt-all.sh

build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)

2024-06-13 00:41:52 +01:00

run-all-perf.sh

scripts : add pipefail

2023-08-29 10:50:30 +03:00

run-all-ppl.sh

build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)

2024-06-13 00:41:52 +01:00

run-with-preset.py

build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)

2024-06-13 00:41:52 +01:00

server-llm.sh

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

sync_vendor.py

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

sync-ggml-am.sh

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

sync-ggml.last

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

sync-ggml.sh

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

tool_bench.py

Tool calls support from mainline (#723)

2025-09-01 08:38:49 +03:00

tool_bench.sh

Tool calls support from mainline (#723)

2025-09-01 08:38:49 +03:00

verify-checksum-models.py

convert.py : add python logging instead of print() (#6511)

2024-05-03 22:36:41 +03:00

xxd.cmake

build: generate hex dump of server assets during build (#6661)

2024-04-21 18:48:53 +01:00