ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-01-31 11:39:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
158 Commits 681 Branches 1 Tag
1d31d737d8c19cb7008ca39cbb42b239389165bb
Commit Graph

3 Commits

Author SHA1 Message Date
Yusuf Kağan Hanoğlu
75ec4e0d8c Add missing header for memcpy (#386) 
fixed: memcpy is not defined
 2023-03-22 10:55:45 +02:00
Georgi Gerganov
5d0d8f903c Init llama_context_params properly from CLI (#370) 2023-03-22 07:45:14 +02:00
Georgi Gerganov
c40b5b3d59 Introduce C-style API (#370) 
* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning
 2023-03-22 07:32:36 +02:00