postmasters 9a92a78e47 llama : add gemma model (#5631) ...

There are couple things in this architecture:

1. Shared input and output embedding parameters.
2. Key length and value length are not derived from `n_embd`.

More information about the models can be found at
https://ai.google.dev/gemma. GGUFs can be downloaded from
https://huggingface.co/google.

2024-02-21 15:08:22 +02:00

503 KiB

Raw Blame History

View Raw