Georgi Gerganov f9a6364912 llama : require first token to be BOS (#1303) ...

* llama : require first token to be BOS

* scripts : add ppl-run-all.sh

* perplexity : add BOS for each chunk

* readme : update perplexity values after BOS fix

* perplexity : add clarifying comments

2023-05-08 17:41:54 +03:00

3.2 KiB

Executable File

Raw Blame History

View Raw