ik_llama.cpp/steps at 9b42c0edec07c46cec2fc6061ca4fb258ac3612a - ik_llama.cpp - Public git mirror

ikawrakow/ik_llama.cpp

mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-08 23:40:10 +00:00

Files

History

Pierrick Hymbert d86aca00e8 server: metrics: add llamacpp:prompt_seconds_total and llamacpp:tokens_predicted_seconds_total, reset bucket only on /metrics. Fix values cast to int. Add Process-Start-Time-Unix header. (#5937 )

Closes #5850

2024-03-08 12:25:04 +01:00

..

steps.py

server: metrics: add llamacpp:prompt_seconds_total and llamacpp:tokens_predicted_seconds_total, reset bucket only on /metrics. Fix values cast to int. Add Process-Start-Time-Unix header. (#5937 )

2024-03-08 12:25:04 +01:00