3 Commits

Author	SHA1	Message	Date
Georgi Gerganov	d23cd25dd0	imatrix : fix assert for src0 non-cont check	2024-01-18 21:45:51 +02:00
Georgi Gerganov	2369070475	imatrix : offload to GPU support (#4957) ... * backend : add eval callback ggml-ci * backend : group nodes in a single compute when user don't need them * backend : clean-up the implementation ggml-ci * simple : do not perform tensor data copy if not needed * simple : fix * imatrix : offload to GPU support * imatrix : fix ggml_mul_mat_id hanlding ggml-ci * ci : add imatrix test ggml-ci * ci : rearrange output ggml-ci	2024-01-17 18:46:30 +02:00
Kawrakow	b8e769ee21	Importance Matrix calculation (#4861) ... * imatrix: 1st version * imatrix: WIP * Cleanup * Update examples/imatrix/imatrix.cpp Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2024-01-12 06:59:57 +01:00