nopperl 460a782b1c Implement the OLMo architecture (#6741) ...

* implement olmo architecture

* remove unused variable

* remove unused moe branch

* remove check for weight

* remove superfluous moe, bias and rope tensors

* clarified comment

* fix clamp_kqv setting

* remove obsolete parameter name filter

2024-04-19 11:35:54 +02:00

689 KiB

Raw Blame History

View Raw