saood06 87bfad8437 Support for Llama-3-Nemotron models (#377) ...

* conflict resolution

* Changes to make work and add longrope support

* Changes to n_attention_wv rule

* Untested support of 253B

* DeciLMCausalModel now reads rope_theta from config.json properly

* Remove errant Granite mentions

* Better n_attention_vw rule

* Update vocab.py

---------

Co-authored-by: Yee Man Chan <ymchan@gmail.com>
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

2025-05-09 10:09:59 +03:00

..

llama.h

Support for Llama-3-Nemotron models (#377)

2025-05-09 10:09:59 +03:00