update readme

This commit is contained in:
qiyuxinlin
2025-05-14 13:13:10 +00:00
parent ee524b0f41
commit c3d0ac80c6
4 changed files with 9 additions and 1 deletions

View File

@@ -117,11 +117,13 @@ Download source code and compile:
```shell
USE_BALANCE_SERVE=1 bash ./install.sh
pip install third_party/custom_flashinfer/
```
- For Multi-concurrency with two cpu and 1T RAM:
```shell
USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh
pip install third_party/custom_flashinfer/
```
- For Windows (Windows native temporarily deprecated, please try WSL)