Johannes Gäßler 1fcdcc28b1 cuda : performance optimizations (#1530) ...

* xor hack

* block y dim

* loop unrolling

* Fixed cmake LLAMA_CUDA_BY option

* Removed hipblas compatibility code

* Define GGML_CUDA_DMMV_BLOCK_Y if not defined

* Fewer iters, more ops per iter

* Renamed DMMV X/Y compilation options

2023-05-26 00:07:29 +03:00

35 KiB

Raw Blame History

View Raw