John Balis 30c2bc69c2 ggml_cuda_cpy support for 4d tensors and float16->float32 upcasting (ggml/686) ...

* added cuda float16->float32 upcasting to ggml_cuda_cpy

* added ability to copy 4d tensors with the cuda backend

* added tests for float16_>float32 upcast and 4d tensor cuda copys

* added 4d copy test for float32->float16 copy

* applied patch suggested by @iamlemec

* simplify cpy tests

---------

Co-authored-by: slaren <slarengh@gmail.com>

2024-01-30 16:20:25 +02:00

..

.gitignore

tests : gitignore test-c.o

2024-01-26 14:48:15 +02:00

CMakeLists.txt

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

get-model.cpp

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

get-model.h

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

test-autorelease.cpp

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

test-backend-ops.cpp

ggml_cuda_cpy support for 4d tensors and float16->float32 upcasting (ggml/686)

2024-01-30 16:20:25 +02:00

test-c.c

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

test-double-float.cpp

ggml : move FP16 <-> FP32 code to ggml-impl.h (#3861)

2023-10-30 19:19:15 +02:00

test-grad0.cpp

cuda : improve cuda pool efficiency using virtual memory (#4606)

2023-12-24 14:34:22 +01:00

test-grammar-parser.cpp

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

test-llama-grammar.cpp

Remove unused data and add fixes (#5154)

2024-01-27 15:25:55 +01:00

test-model-load-cancel.cpp

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

test-opt.cpp

sync : ggml (backend v2) (#3912)

2023-11-13 14:16:23 +02:00

test-quantize-fns.cpp

SOTA 3-bit quants (#5196)

2024-01-30 15:14:12 +02:00

test-quantize-perf.cpp

SOTA 3-bit quants (#5196)

2024-01-30 15:14:12 +02:00

test-rope.cpp

llama : custom attention mask + parallel decoding + no context swaps (#3228)

2023-09-28 19:04:36 +03:00

test-sampling.cpp

Tests for min_p, sampling queue (#5147)

2024-01-28 09:35:14 +01:00

test-tokenizer-0-falcon.cpp

Minor improvements in GPT2 tokenizer (#3567)

2023-10-10 18:59:52 +02:00

test-tokenizer-0-falcon.py

ci : add flake8 to github actions (python linting) (#4129)

2023-11-20 11:35:47 +01:00

test-tokenizer-0-llama.cpp

Minor improvements in GPT2 tokenizer (#3567)

2023-10-10 18:59:52 +02:00

test-tokenizer-0-llama.py

ci : add flake8 to github actions (python linting) (#4129)

2023-11-20 11:35:47 +01:00

test-tokenizer-1-bpe.cpp

Add more tokenizer tests (#3742)

2023-10-24 09:17:17 +02:00

test-tokenizer-1-llama.cpp

Work on the BPE tokenizer (#3252)

2023-10-03 09:16:26 +02:00