Introduce C-style API (#370)

Browse Source

* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning

...

This commit is contained in:

Georgi Gerganov

2023-03-22 07:32:36 +02:00

committed by GitHub

parent 3081cf8ed9

commit c40b5b3d59

14 changed files with 1954 additions and 1752 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

914

main.cpp

File diff suppressed because it is too large Load Diff