Add gallery
@@ -19,6 +19,7 @@ This work presents Depth Anything, a highly practical solution for robust monocu
|
||||
|
||||
## News
|
||||
|
||||
* **2024-02-05:** [Depth Anything Gallery](./gallery.md) is released. Thank all the users!
|
||||
* **2024-02-02:** Depth Anything serves as the default depth processor for [InstantID](https://github.com/InstantID/InstantID) and [InvokeAI](https://github.com/invoke-ai/InvokeAI/releases/tag/v3.6.1).
|
||||
* **2024-01-25:** Support [video depth visualization](./run_video.py).
|
||||
* **2024-01-23:** The new ControlNet based on Depth Anything is integrated into [ControlNet WebUI](https://github.com/Mikubill/sd-webui-controlnet) and [ComfyUI's ControlNet](https://github.com/Fannovel16/comfyui_controlnet_aux).
|
||||
|
||||
BIN
assets/gallery/3d_video.gif
Normal file
|
After Width: | Height: | Size: 16 MiB |
BIN
assets/gallery/3d_vis1.gif
Normal file
|
After Width: | Height: | Size: 11 MiB |
BIN
assets/gallery/3d_vis2.gif
Normal file
|
After Width: | Height: | Size: 17 MiB |
BIN
assets/gallery/aerial_image.jpg
Normal file
|
After Width: | Height: | Size: 241 KiB |
BIN
assets/gallery/animation_image.jpg
Normal file
|
After Width: | Height: | Size: 916 KiB |
BIN
assets/gallery/artistic_image.jpg
Normal file
|
After Width: | Height: | Size: 559 KiB |
BIN
assets/gallery/astronaut_cat.jpg
Normal file
|
After Width: | Height: | Size: 842 KiB |
BIN
assets/gallery/building.gif
Normal file
|
After Width: | Height: | Size: 5.8 MiB |
BIN
assets/gallery/cat.jpg
Normal file
|
After Width: | Height: | Size: 107 KiB |
BIN
assets/gallery/chibi_cateared_character.jpg
Normal file
|
After Width: | Height: | Size: 706 KiB |
BIN
assets/gallery/cyber_rabbit.jpg
Normal file
|
After Width: | Height: | Size: 705 KiB |
BIN
assets/gallery/dalle_bear.jpg
Normal file
|
After Width: | Height: | Size: 506 KiB |
BIN
assets/gallery/diner_scene.jpg
Normal file
|
After Width: | Height: | Size: 222 KiB |
BIN
assets/gallery/distracted_man.jpg
Normal file
|
After Width: | Height: | Size: 698 KiB |
BIN
assets/gallery/elon_musk.jpg
Normal file
|
After Width: | Height: | Size: 568 KiB |
BIN
assets/gallery/eye-stalked.jpg
Normal file
|
After Width: | Height: | Size: 704 KiB |
BIN
assets/gallery/football_game.jpg
Normal file
|
After Width: | Height: | Size: 308 KiB |
BIN
assets/gallery/gamer_celebration.jpg
Normal file
|
After Width: | Height: | Size: 890 KiB |
BIN
assets/gallery/grilled_chicken_skewers.jpg
Normal file
|
After Width: | Height: | Size: 338 KiB |
BIN
assets/gallery/indoor_moving.gif
Normal file
|
After Width: | Height: | Size: 17 MiB |
BIN
assets/gallery/iron_man.jpg
Normal file
|
After Width: | Height: | Size: 578 KiB |
BIN
assets/gallery/minecraft.jpg
Normal file
|
After Width: | Height: | Size: 811 KiB |
BIN
assets/gallery/monster.png
Normal file
|
After Width: | Height: | Size: 5.5 MiB |
BIN
assets/gallery/monument_valley.jpg
Normal file
|
After Width: | Height: | Size: 412 KiB |
BIN
assets/gallery/ocean.jpg
Normal file
|
After Width: | Height: | Size: 870 KiB |
BIN
assets/gallery/painted_tunnel.jpg
Normal file
|
After Width: | Height: | Size: 303 KiB |
BIN
assets/gallery/racing_car.gif
Normal file
|
After Width: | Height: | Size: 23 MiB |
BIN
assets/gallery/raft_painting.jpg
Normal file
|
After Width: | Height: | Size: 603 KiB |
BIN
assets/gallery/reconstruction.jpg
Normal file
|
After Width: | Height: | Size: 539 KiB |
BIN
assets/gallery/reconstruction2.jpeg
Normal file
|
After Width: | Height: | Size: 158 KiB |
BIN
assets/gallery/robotic_knight.jpg
Normal file
|
After Width: | Height: | Size: 566 KiB |
BIN
assets/gallery/skull.jpg
Normal file
|
After Width: | Height: | Size: 483 KiB |
BIN
assets/gallery/surprised_bald_man.jpg
Normal file
|
After Width: | Height: | Size: 499 KiB |
BIN
assets/gallery/tearful_green_frog.jpg
Normal file
|
After Width: | Height: | Size: 389 KiB |
BIN
assets/gallery/videoframe_10000.png
Normal file
|
After Width: | Height: | Size: 255 KiB |
@@ -53,7 +53,7 @@ Please follow [ZoeDepth](https://github.com/isl-org/ZoeDepth) to prepare the tra
|
||||
|
||||
## Evaluation
|
||||
|
||||
Make sure you have downloaded our pre-trained models [here](https://huggingface.co/spaces/LiheYoung/Depth-Anything/tree/main/checkpoints_metric_depth) and put them under the ``checkpoints`` directory.
|
||||
Make sure you have downloaded our pre-trained metric-depth models [here](https://huggingface.co/spaces/LiheYoung/Depth-Anything/tree/main/checkpoints_metric_depth) (for evaluation) and pre-trained relative-depth model [here](https://huggingface.co/spaces/LiheYoung/Depth-Anything/blob/main/checkpoints/depth_anything_vitl14.pth) (for initializing the encoder) and put them under the ``checkpoints`` directory.
|
||||
|
||||
Indoor:
|
||||
```bash
|
||||
@@ -67,7 +67,7 @@ python evaluate.py -m zoedepth --pretrained_resource="local::./checkpoints/depth
|
||||
|
||||
## Training
|
||||
|
||||
Please first download our Depth Anything pre-trained models [here](https://huggingface.co/spaces/LiheYoung/Depth-Anything/blob/main/checkpoints/depth_anything_vitl14.pth), and put it under the ``checkpoints`` directory.
|
||||
Please first download our Depth Anything pre-trained model [here](https://huggingface.co/spaces/LiheYoung/Depth-Anything/blob/main/checkpoints/depth_anything_vitl14.pth), and put it under the ``checkpoints`` directory.
|
||||
|
||||
```bash
|
||||
python train_mono.py -m zoedepth -d <nyu | kitti> --pretrained_resource=""
|
||||
|
||||
@@ -37,18 +37,22 @@ Note that our results are obtained *without* Mapillary pre-training.
|
||||
- [Cityscapes-ViT-L-mIoU-86.4](https://huggingface.co/spaces/LiheYoung/Depth-Anything/blob/main/checkpoints_semseg/cityscapes_vitl_mIoU_86.4.pth)
|
||||
- [ADE20K-ViT-L-mIoU-59.4](https://huggingface.co/spaces/LiheYoung/Depth-Anything/blob/main/checkpoints_semseg/ade20k_vitl_mIoU_59.4.pth)
|
||||
|
||||
**Note:** If you want to reproduce the training process, please 1) download the [Depth Anything pre-trained model](https://huggingface.co/spaces/LiheYoung/Depth-Anything/blob/main/checkpoints/depth_anything_vitl14.pth) (to initialize the encoder) and 2) put it under the ``checkpoints`` folder.
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
Please refer to [MMSegmentation](https://github.com/open-mmlab/mmsegmentation/blob/main/docs/en/get_started.md#installation) for instructions.
|
||||
|
||||
Please also install mmdet to support Mask2Former:
|
||||
```bash
|
||||
pip install "mmdet>=3.0.0rc4"
|
||||
```
|
||||
|
||||
After installation:
|
||||
- move our [config/depth_anything](./config/depth_anything/) to mmseg's [config](https://github.com/open-mmlab/mmsegmentation/tree/main/configs)
|
||||
- move our [dinov2.py](./dinov2.py) to mmseg's [backbones](https://github.com/open-mmlab/mmsegmentation/tree/main/mmseg/models/backbones)
|
||||
- add DINOv2 in mmseg's [models/backbones/\_\_init\_\_.py](https://github.com/open-mmlab/mmsegmentation/blob/main/mmseg/models/backbones/__init__.py)
|
||||
- download our provided [torchhub](https://github.com/LiheYoung/Depth-Anything/tree/main/torchhub) directory and put it at the root of your working directory
|
||||
|
||||
For training or inference with our pre-trained models, please refer to MMSegmentation [instructions](https://github.com/open-mmlab/mmsegmentation/blob/main/docs/en/user_guides/4_train_test.md).
|
||||
**Note:** If you want to reproduce the **training** process, please 1) download the [Depth Anything pre-trained model](https://huggingface.co/spaces/LiheYoung/Depth-Anything/blob/main/checkpoints/depth_anything_vitl14.pth) (to initialize the encoder) and 2) put it under the ``checkpoints`` folder.
|
||||
|
||||
For training or inference with our pre-trained models, please refer to MMSegmentation [instructions](https://github.com/open-mmlab/mmsegmentation/blob/main/docs/en/user_guides/4_train_test.md).
|
||||
|
||||