Tobias Lütke 2978dd92ec Expose generation timings from server & update completions.js (#2116) ...

* use javascript generators as much cleaner API

Also add ways to access completion as promise and EventSource

* export llama_timings as struct and expose them in server

* update readme, update baked includes

* llama : uniform variable names + struct init

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2023-07-05 16:51:13 -04:00

543 B

Executable File

Raw Blame History

View Raw