ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-01-26 17:20:01 +00:00
Code Issues Packages Projects Releases Wiki Activity

Specify tensor name regex for tensors to be repacked (#274)

Browse Source 
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
This commit is contained in:
Kawrakow
2025-03-21 10:51:37 +01:00
committed by GitHub
parent 24e780ba74
commit 4158743014
3 changed files with 52 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
include/llama.h
View File

@@ -420,6 +420,7 @@ extern "C" {
void * imatrix; // pointer to importance matrix data
void * kv_overrides; // pointer to vector containing overrides
void * custom_quants; // pointer to vector containing custom quantization rules
void * repack_pattern; // pointer to a vector containing regexes to be used for matching tensor names. Can be null
} llama_model_quantize_params;
// grammar types