---
title: "Use Models From ModelScope"
---

To use a model from [ModelScope](https://www.modelscope.cn), set the environment variable `SGLANG_USE_MODELSCOPE`.

<CodeGroup>
```bash Set Environment Variable
export SGLANG_USE_MODELSCOPE=true
```
</CodeGroup>

We take [Qwen2-7B-Instruct](https://www.modelscope.cn/models/qwen/qwen2-7b-instruct) as an example.

## Launch the Server

<CodeGroup>
```bash Python
python -m sglang.launch_server --model-path qwen/Qwen2-7B-Instruct --port 30000
```
```bash Docker
docker run --gpus all \
    -p 30000:30000 \
    -v ~/.cache/modelscope:/root/.cache/modelscope \
    --env "SGLANG_USE_MODELSCOPE=true" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server --model-path Qwen/Qwen2.5-7B-Instruct --host 0.0.0.0 --port 30000
```
</CodeGroup>

<Note>ModelScope uses a different cache directory than Hugging Face. You may need to set it manually to avoid running out of disk space.</Note>