Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Zzh-tju authored May 4, 2020
1 parent 1e12b8b commit beab4e3
Showing 1 changed file with 19 additions and 18 deletions.
37 changes: 19 additions & 18 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -124,27 +124,28 @@ python eval.py --trained_model=weights/yolact_base_54_800000.pth --benchmark
### Hardware and main parameters
- 1 GTX 1080 Ti
- Intel(R) Core(TM) i7-6850K CPU @ 3.60GHz
- Image Size: 550. Backbone: Resnet101-FPN.
| Image Size | Backbone | Loss | NMS | FPS | box AP | box AP75 | box AR100 | mask AP | mask AP75 | mask AR100 |
|:----:|:-------------:|:-------:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|
| 550 | Resnet101-FPN | CIoU | Fast NMS | 30.6 | 32.1 | 33.9 | 43.0 | 29.6 | 30.9 | 40.3 |
| 550 | Resnet101-FPN | CIoU | Original NMS | 11.5 | 32.5 | 34.1 | 45.1 | 29.7 | 31.0 | 41.7 |
| 550 | Resnet101-FPN | CIoU | Cluster-NMS | 28.8 | 32.5 | 34.1 | 45.2 | 29.7 | 31.0 | 41.7 |
| 550 | Resnet101-FPN | CIoU | SPM Cluster-NMS | 28.6 | 33.1 | 35.2 | 48.8 | 30.3 | 31.7 | 43.6 |
| 550 | Resnet101-FPN | CIoU | SPM + Distance Cluster-NMS | 27.1 | 33.2 | 35.2 | 49.2 | 30.2 | 31.7 | 43.8 |
| 550 | Resnet101-FPN | CIoU | SPM + Distance + Weighted Cluster-NMS | 26.5 | 33.4 | 35.5 | 49.1 | 30.3 | 31.6 | 43.8 |
- Image Size: 550
- Backbone: Resnet101-FPN
| Loss | NMS | FPS | box AP | box AP75 | box AR100 | mask AP | mask AP75 | mask AR100 |
|:-------:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|
| CIoU | Fast NMS | 30.6 | 32.1 | 33.9 | 43.0 | 29.6 | 30.9 | 40.3 |
| CIoU | Original NMS | 11.5 | 32.5 | 34.1 | 45.1 | 29.7 | 31.0 | 41.7 |
| CIoU | Cluster-NMS | 28.8 | 32.5 | 34.1 | 45.2 | 29.7 | 31.0 | 41.7 |
| CIoU | SPM Cluster-NMS | 28.6 | 33.1 | 35.2 | 48.8 | 30.3 | 31.7 | 43.6 |
| CIoU | SPM + Distance Cluster-NMS | 27.1 | 33.2 | 35.2 | 49.2 | 30.2 | 31.7 | 43.8 |
| CIoU | SPM + Distance + Weighted Cluster-NMS | 26.5 | 33.4 | 35.5 | 49.1 | 30.3 | 31.6 | 43.8 |
The following table is evaluated by using their pretrained weighted of YOLACT. ([yolact_base_54_800000.pth](https://drive.google.com/file/d/1UYy3dMapbH1BnmtZU4WH1zbYgOzzHHf_/view?usp=sharing))
| Image Size | Backbone | Loss | NMS | FPS | box AP | box AP75 | box AR100 | mask AP | mask AP75 | mask AR100 |
|:----:|:-------------:|:-------:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|
| 550 | Resnet101-FPN | SL1 | Fast NMS | 30.6 | 32.5 | 34.6 | 43.9 | 29.8 | 31.3 | 40.8 |
| 550 | Resnet101-FPN | SL1 | Original NMS | 11.9 | 32.9 | 34.8 | 45.8 | 29.9 | 31.4 | 42.1 |
| 550 | Resnet101-FPN | SL1 | Cluster-NMS | 29.2 | 32.9 | 34.8 | 45.9 | 29.9 | 31.4 | 42.1 |
| 550 | Resnet101-FPN | SL1 | SPM Cluster-NMS | 28.8 | 33.5 | 35.9 | 49.7 | 30.5 | 32.1 | 44.1 |
| 550 | Resnet101-FPN | SL1 | SPM + Distance Cluster-NMS | 27.5 | 33.5 | 35.9 | 50.2 | 30.4 | 32.0 | 44.3 |
| 550 | Resnet101-FPN | SL1 | SPM + Distance + Weighted Cluster-NMS | 26.7 | 34.0 | 36.6 | 49.9 | 30.5 | 32.0 | 44.3 |
| Loss | NMS | FPS | box AP | box AP75 | box AR100 | mask AP | mask AP75 | mask AR100 |
|:-------:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|
| SL1 | Fast NMS | 30.6 | 32.5 | 34.6 | 43.9 | 29.8 | 31.3 | 40.8 |
| SL1 | Original NMS | 11.9 | 32.9 | 34.8 | 45.8 | 29.9 | 31.4 | 42.1 |
| SL1 | Cluster-NMS | 29.2 | 32.9 | 34.8 | 45.9 | 29.9 | 31.4 | 42.1 |
| SL1 | SPM Cluster-NMS | 28.8 | 33.5 | 35.9 | 49.7 | 30.5 | 32.1 | 44.1 |
| SL1 | SPM + Distance Cluster-NMS | 27.5 | 33.5 | 35.9 | 50.2 | 30.4 | 32.0 | 44.3 |
| SL1 | SPM + Distance + Weighted Cluster-NMS | 26.7 | 34.0 | 36.6 | 49.9 | 30.5 | 32.0 | 44.3 |
##### Note:
- Things we did but did not appear in the paper: SPM + Distance + Weighted Cluster-NMS. Here the box coordinate weighted average is only performed in `IoU> 0.8`. (We searched that `IoU>0.5` is not good for YOLACT and `IoU>0.9` is almost same to `SPM + Distance Cluster-NMS`.)
- The Original NMS impremented by YOLACT is faster than ours, because they firstly use a score threshold (0.05) to get the set of candidate boxes, then do NMS will be faster (22 ~ 23 FPS with a slight performance drop). In order to get the same result with our Cluster-NMS, we modify the process of Original NMS.
Expand Down

0 comments on commit beab4e3

Please sign in to comment.