ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-01 03:59:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
2546cef587bc6bdcb87bc2e2a34d8aca0f7a90a7
ik_llama.cpp/examples/speculative
History
Georgi Gerganov dd8b7789a0 llama : add option for greedy sampling with probs (#3813) 
* llama : add option for greedy sampling with probs

* llama : add comment about llama_sample_token_greedy() missing probs

* sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs
2023-10-28 14:23:11 +03:00
..
CMakeLists.txt
speculative : PoC for speeding-up inference via speculative sampling (#2926)
2023-09-03 15:12:08 +03:00
speculative.cpp
llama : add option for greedy sampling with probs (#3813)
2023-10-28 14:23:11 +03:00