4 Commits

Author	SHA1	Message	Date
Kawrakow	0ceeb11721	Merge mainline llama.cpp (#3) ... * Merging mainline - WIP * Merging mainline - WIP AVX2 and CUDA appear to work. CUDA performance seems slightly (~1-2%) lower as it is so often the case with llama.cpp/ggml after some "improvements" have been made. * Merging mainline - fix Metal * Remove check --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>	2024-07-27 07:55:01 +02:00
luoyu-intel	20a2d77aa2	[SYCL] Fix windows build and inference (#8003) ... * add sycl preset * fix debug link error. fix windows crash * update README	2024-06-20 21:19:05 +08:00
kunnis	2e63949afa	adding in x64 targets to cmake presets (#7574)	2024-05-28 01:40:12 +02:00
Max Krasnyansky	5cc8a89c08	Add support for properly optimized Windows ARM64 builds with LLVM and MSVC (#7191) ... * logging: add proper checks for clang to avoid errors and warnings with VA_ARGS * build: add CMake Presets and toolchian files for Windows ARM64 * matmul-int8: enable matmul-int8 with MSVC and fix Clang warnings * ci: add support for optimized Windows ARM64 builds with MSVC and LLVM * matmul-int8: fixed typos in q8_0_q8_0 matmuls Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * matmul-int8: remove unnecessary casts in q8_0_q8_0 --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2024-05-16 12:47:36 +10:00