ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-04-29 10:51:51 +00:00
Code Issues Packages Projects Releases Wiki Activity

Send [DONE] for OAI compatibility (#470)

Browse Source 
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
This commit is contained in:
Kawrakow
2025-06-17 10:32:53 +03:00
committed by GitHub
parent 23ac643459
commit b8142a583d
3 changed files with 18 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
common/common.h
View File

@@ -223,6 +223,7 @@ struct gpt_params {
int32_t timeout_read = 600; // http read timeout in seconds
int32_t timeout_write = timeout_read; // http write timeout in seconds
int32_t n_threads_http = -1; // number of threads to process HTTP requests
bool send_done = false; // send done message as required for OAI compatibility
std::string hostname = "127.0.0.1";
std::string public_path = "";