Kawrakow 05dbbeaf14 imatrix: collect layer influence statistics (#328) ...

* imatrix: collect layer influence statistics

* imatrix: collect layer influence statiscs also for the last layer

For the last layer we need to use the input for the output.weight
tensor. Last layer(s) tend(s) to be important, so it is useful to also
have its influence metric.

* imatrix: separate metric for attention and ffn importance

* Use stripped tensor name, not src0->name

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

2025-04-14 19:43:19 +02:00

32 KiB

Raw Blame History

View Raw