From b4d42145fa992fb815599daef102090a408ea10c Mon Sep 17 00:00:00 2001 From: Bingsu Date: Mon, 8 May 2023 10:39:53 +0900 Subject: [PATCH] docs: segment model, datasets --- README.md | 67 +++++++++++++++++++++++++++++++++++-------------------- 1 file changed, 43 insertions(+), 24 deletions(-) diff --git a/README.md b/README.md index cb77f64..0861d66 100644 --- a/README.md +++ b/README.md @@ -16,31 +16,9 @@ You **DON'T** need to download any model from huggingface. -## Model +## Usage -| Model | Target | mAP 50 | mAP 50-95 | -| -------------------- | ------------------- | ------ | --------- | -| face_yolov8n.pt | 2D / realistic face | 0.660 | 0.366 | -| face_yolov8s.pt | 2D / realistic face | 0.713 | 0.404 | -| mediapipe_face_full | realistic | - | - | -| mediapipe_face_short | realistic | - | - | - -The yolo models can be found on huggingface [Bingsu/adetailer](https://huggingface.co/Bingsu/adetailer). - -### Dataset - -Datasets used for training the yolo face detection models are: - -- [roboflow AN](https://universe.roboflow.com/sed-b8vkf/an-lfg5i) -- [roboflow Anime Face CreateML](https://universe.roboflow.com/my-workspace-mph8o/anime-face-createml) -- [roboflow xml2txt](https://universe.roboflow.com/0oooooo0/xml2txt-njqx1) -- [wider face](http://shuoyang1213.me/WIDERFACE/index.html) - -### User Model - -Put your [ultralytics](https://github.com/ultralytics/ultralytics) model in `webui/models/adetailer`. The model name should end with `.pt` or `.pth`. - -It must be a bbox detection model and use only label 0. +TO DO ## ControlNet Inpainting @@ -48,6 +26,47 @@ You can use the ControlNet inpaint extension if you have ControlNet installed an On the ControlNet tab, select a ControlNet inpaint model and set the model weights. +## Model + +| Model | Target | mAP 50 | mAP 50-95 | +| --------------------- | --------------------- | ----------------------------- | ----------------------------- | +| face_yolov8n.pt | 2D / realistic face | 0.660 | 0.366 | +| face_yolov8s.pt | 2D / realistic face | 0.713 | 0.404 | +| mediapipe_face_full | realistic face | - | - | +| mediapipe_face_short | realistic face | - | - | +| hand_yolov8n.pt | 2D / realistic hand | 0.767 | 0.505 | +| person_yolov8n-seg.pt | 2D / realistic person | 0.782 (bbox)
0.761 (mask) | 0.555 (bbox)
0.460 (mask) | + +The yolo models can be found on huggingface [Bingsu/adetailer](https://huggingface.co/Bingsu/adetailer). + +### User Model + +Put your [ultralytics](https://github.com/ultralytics/ultralytics) model in `webui/models/adetailer`. The model name should end with `.pt` or `.pth`. + +It must be a bbox detection or segment model and use all label. + +### Dataset + +Datasets used for training the yolo models are: + +#### Face + +- [Anime Face CreateML](https://universe.roboflow.com/my-workspace-mph8o/anime-face-createml) +- [xml2txt](https://universe.roboflow.com/0oooooo0/xml2txt-njqx1) +- [AN](https://universe.roboflow.com/sed-b8vkf/an-lfg5i) +- [wider face](http://shuoyang1213.me/WIDERFACE/index.html) + +#### Hand + +- [AnHDet](https://universe.roboflow.com/1-yshhi/anhdet) +- [hand-detection-fuao9](https://universe.roboflow.com/catwithawand/hand-detection-fuao9) + +#### Person + +- [coco2017](https://cocodataset.org/#home) (only person) +- [AniSeg](https://github.com/jerryli27/AniSeg) +- [skytnt/anime-segmentation](https://huggingface.co/datasets/skytnt/anime-segmentation) + ## Example ![image](https://i.imgur.com/i74ukgi.png)