Iwan Kawrakow 0a3a2c4cd4 imatrix: be able to specify the name of the output tensor ...

For some models the same tensor is used for token embeddings and
output. This tensor tends to be named token_embedding.weight rather
than output.weight, which prevernts us from collecting imatrix data
for this tensor. With this commit we can tell the name of the
output tensor to the imatrix tool.

2024-06-26 17:38:18 +03:00

136 KiB

Raw Blame History

View Raw