ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-09 07:50:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,048 Commits 698 Branches 1 Tag
2bce5a7e2c5dfd3a8dd66fa07cc456ce2930e921
Commit Graph

4 Commits

Author SHA1 Message Date
Richard Kiss
1249c107d3 english : use typos to fix comments and logs (#4354) 2023-12-12 11:53:36 +02:00
Georgi Gerganov
65125b5b15 examples : add readme files 2023-11-29 11:00:17 +02:00
Georgi Gerganov
03d295f72b lookahead : support -n -1 infinite generation 2023-11-26 21:52:23 +02:00
Georgi Gerganov
538b538dec lookahead : add example for lookahead decoding (#4207) 
* lookahead : init

* lookahead : generate and store n-grams

* lookahead : use loop instead recursion to generate n-grams

* lookahead : initial working implementation

* lookahead : filter repeating n-grams

* lookahead : use deterministic init

* lookahead : add to Makefile

* lookahead : fix a bug in the seq_id of the lookahead tokens

* lookahead : add comments

---------

Co-authored-by: slaren <slarengh@gmail.com>
 2023-11-26 20:33:07 +02:00