Sourab Mangrulkar c29af7e225 llama : add StarCoder2 support (#5795) ...

* Add support for starcoder2

* handle rope type

* skip rope freq and rotary embeddings from being serialized

* resolve comments

* Update llama.cpp

* remove redundant changes

* handle `rope-theta`

* llama : change starcoder2 rope type

* address comment

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2024-03-01 21:30:46 +02:00

17 KiB

Raw Blame History

View Raw