mirror of
https://github.com/ikawrakow/ik_llama.cpp.git
synced 2026-02-24 07:04:11 +00:00
Update README.md for main and server
This commit is contained in:
@@ -239,6 +239,17 @@ The `--mirostat-ent` option sets the Mirostat target entropy (tau), which repres
|
||||
|
||||
Example usage: `--mirostat 2 --mirostat-lr 0.05 --mirostat-ent 3.0`
|
||||
|
||||
### XTC Sampling
|
||||
|
||||
- --xtc-probability p: xtc probability (default: 0.0 => disabled)
|
||||
- --xtc-threshold t : xtc threshold (default: 1.0 => disabled)
|
||||
|
||||
### Top-n-sigma Sampling
|
||||
|
||||
Sets all logits $L_i$ to $-\infty$ where $L_i < L_{\rm max} - n \sigma$. Here $L_{\rm max}$ is the maximum logit, $\sigma$ is the logit standard deviation, and $n$ is the top-n-sigma parameter.
|
||||
|
||||
- --top-n-sigma t top-n-sigma parmeter (default: 0.0 => disabled)
|
||||
|
||||
### Logit Bias
|
||||
|
||||
- `-l TOKEN_ID(+/-)BIAS, --logit-bias TOKEN_ID(+/-)BIAS`: Modify the likelihood of a token appearing in the generated text completion.
|
||||
|
||||
@@ -98,6 +98,9 @@ sampling:
|
||||
(default: 0, 0 = disabled, 1 = Mirostat, 2 = Mirostat 2.0)
|
||||
--mirostat-lr N Mirostat learning rate, parameter eta (default: 0.1)
|
||||
--mirostat-ent N Mirostat target entropy, parameter tau (default: 5.0)
|
||||
--xtc-probability p xtc probability (default: 0.0 => disabled)
|
||||
--xtc-threshold t xtc threshold (default: 1.0 => disabled)
|
||||
--top-n-sigma t top-n-sigma parmeter (default: 0.0 => disabled)
|
||||
-l TOKEN_ID(+/-)BIAS modifies the likelihood of token appearing in the completion,
|
||||
i.e. `--logit-bias 15043+1` to increase likelihood of token ' Hello',
|
||||
or `--logit-bias 15043-1` to decrease likelihood of token ' Hello'
|
||||
|
||||
Reference in New Issue
Block a user