mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-04-30 03:01:16 +00:00
update readme
This commit is contained in:
@@ -117,11 +117,13 @@ Download source code and compile:
|
||||
|
||||
```shell
|
||||
USE_BALANCE_SERVE=1 bash ./install.sh
|
||||
pip install third_party/custom_flashinfer/
|
||||
```
|
||||
- For Multi-concurrency with two cpu and 1T RAM:
|
||||
|
||||
```shell
|
||||
USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh
|
||||
pip install third_party/custom_flashinfer/
|
||||
```
|
||||
- For Windows (Windows native temporarily deprecated, please try WSL)
|
||||
|
||||
|
||||
Reference in New Issue
Block a user