Nexes the Elder 03cabe1540 CLI - Specify GGML_TYPE to quantize for the main tensors. (#91) ...

To complement the token_embd.weight and output.weight :

attn_v.weight
attn_k.weight.
attn_q_weight
attn_output.weight
attn_qkv.weight
ffn_gate
ffn_down
ffn_up

2024-10-18 09:48:15 +02:00

58 KiB

Raw Blame History

View Raw