Update README.md

lvyong1943 · May 5, 2020 · e1c136f · e1c136f
1 parent e472a9f
commit e1c136f
Showing 1 changed file with 24 additions and 24 deletions.
diff --git a/README.md b/README.md
@@ -127,45 +127,45 @@ python eval.py --trained_model=weights/yolact_base_54_800000.pth --benchmark
 
 | Image Size | Backbone  | Loss  | NMS  | FPS  | box AP | box AP75 | box AR100 | mask AP | mask AP75 | mask AR100 |
 |:----:|:-------------:|:-------:|:------------------------------------:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|
-| 550  | Resnet101-FPN | CIoU  |                 Fast NMS               | 30.6 | 32.1 | 33.9 | 43.0 | 29.6 | 30.9 | 40.3 |
-| 550  | Resnet101-FPN | CIoU  |               Original NMS             | 11.5 | 32.5 | 34.1 | 45.1 | 29.7 | 31.0 | 41.7 |
-| 550  | Resnet101-FPN | CIoU  |               Cluster-NMS              | 28.8 | 32.5 | 34.1 | 45.2 | 29.7 | 31.0 | 41.7 |
-| 550  | Resnet101-FPN | CIoU  |             SPM Cluster-NMS            | 28.6 | 33.1 | 35.2 | 48.8 | 30.3 | 31.7 | 43.6 |
-| 550  | Resnet101-FPN | CIoU  |       SPM + Distance Cluster-NMS       | 27.1 | 33.2 | 35.2 | 49.2 | 30.2 | 31.7 | 43.8 |
-| 550  | Resnet101-FPN | CIoU  | SPM + Distance + Weighted Cluster-NMS  | 26.5 | 33.4 | 35.5 | 49.1 | 30.3 | 31.6 | 43.8 |
+| 550  | Resnet101-FPN | CIoU  |                 Fast NMS               |**30.6**|  32.1  |  33.9  |  43.0  |  29.6  |  30.9  |  40.3  |
+| 550  | Resnet101-FPN | CIoU  |               Original NMS             |  11.5  |  32.5  |  34.1  |  45.1  |  29.7  |  31.0  |  41.7  |
+| 550  | Resnet101-FPN | CIoU  |               Cluster-NMS              |  28.8  |  32.5  |  34.1  |  45.2  |  29.7  |  31.0  |  41.7  |
+| 550  | Resnet101-FPN | CIoU  |             SPM Cluster-NMS            |  28.6  |  33.1  |  35.2  |  48.8  |**30.3**|**31.7**|  43.6  |
+| 550  | Resnet101-FPN | CIoU  |       SPM + Distance Cluster-NMS       |  27.1  |  33.2  |  35.2  |**49.2**|  30.2  |**31.7**|**43.8**|
+| 550  | Resnet101-FPN | CIoU  | SPM + Distance + Weighted Cluster-NMS  |  26.5  |**33.4**|**35.5**|  49.1  |**30.3**|  31.6  |**43.8**|
 
 The following table is evaluated by using their pretrained weighted of YOLACT. ([yolact_resnet50_54_800000.pth](https://ucdavis365-my.sharepoint.com/:u:/g/personal/yongjaelee_ucdavis_edu/EUVpxoSXaqNIlssoLKOEoCcB1m0RpzGq_Khp5n1VX3zcUw))
 
 | Image Size | Backbone  | Loss  | NMS  | FPS  | box AP | box AP75 | box AR100 | mask AP | mask AP75 | mask AR100 |
 |:----:|:-------------:|:-------:|:-----------------------------------:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|
-| 550  | Resnet50-FPN | SL1  |                 Fast NMS               | 41.6 | 30.2 | 31.9 | 42.0 | 28.0 | 29.1 | 39.4 |
-| 550  | Resnet50-FPN | SL1  |               Original NMS             | 12.8| 30.7 | 32.0 | 44.1 | 28.1 | 29.2 | 40.7 |
-| 550  | Resnet50-FPN | SL1  |               Cluster-NMS              | 38.2 | 30.7 | 32.0 | 44.1 | 28.1 | 29.2 | 40.7 |
-| 550  | Resnet50-FPN | SL1  |             SPM Cluster-NMS            | 37.7 | 31.3 | 33.2 | 48.0 | 28.8 | 29.9 | 42.8 |
-| 550  | Resnet50-FPN | SL1  |       SPM + Distance Cluster-NMS       | 35.2 | 31.3 | 33.3 | 48.2 | 28.7 | 29.9 | 42.9 |
-| 550  | Resnet50-FPN | SL1  | SPM + Distance + Weighted Cluster-NMS  | 34.2 | 31.8 | 33.9 | 48.3 | 28.8 | 29.9 | 43.0 |
+| 550  | Resnet50-FPN | SL1  |                 Fast NMS               |**41.6**|  30.2  |  31.9  |  42.0  |  28.0  |  29.1  |  39.4  |
+| 550  | Resnet50-FPN | SL1  |               Original NMS             |  12.8  |  30.7  |  32.0  |  44.1  |  28.1  |  29.2  |  40.7  |
+| 550  | Resnet50-FPN | SL1  |               Cluster-NMS              |  38.2  |  30.7  |  32.0  |  44.1  |  28.1  |  29.2  |  40.7  |
+| 550  | Resnet50-FPN | SL1  |             SPM Cluster-NMS            |  37.7  |  31.3  |  33.2  |  48.0  |**28.8**|**29.9**|  42.8  |
+| 550  | Resnet50-FPN | SL1  |       SPM + Distance Cluster-NMS       |  35.2  |  31.3  |  33.3  |  48.2  |  28.7  |**29.9**|  42.9  |
+| 550  | Resnet50-FPN | SL1  | SPM + Distance + Weighted Cluster-NMS  |  34.2  |**31.8**|**33.9**|**48.3**|**28.8**|**29.9**|**43.0**|
 
 The following table is evaluated by using their pretrained weighted of YOLACT. ([yolact_base_54_800000.pth](https://drive.google.com/file/d/1UYy3dMapbH1BnmtZU4WH1zbYgOzzHHf_/view?usp=sharing))
 
 | Image Size | Backbone  | Loss  | NMS  | FPS  | box AP | box AP75 | box AR100 | mask AP | mask AP75 | mask AR100 |
 |:----:|:-------------:|:-------:|:-----------------------------------:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|
-| 550  | Resnet101-FPN | SL1  |                 Fast NMS               | 30.6 | 32.5 | 34.6 | 43.9 | 29.8 | 31.3 | 40.8 |
-| 550  | Resnet101-FPN | SL1  |               Original NMS             | 11.9 | 32.9 | 34.8 | 45.8 | 29.9 | 31.4 | 42.1 |
-| 550  | Resnet101-FPN | SL1  |               Cluster-NMS              | 29.2 | 32.9 | 34.8 | 45.9 | 29.9 | 31.4 | 42.1 |
-| 550  | Resnet101-FPN | SL1  |             SPM Cluster-NMS            | 28.8 | 33.5 | 35.9 | 49.7 | 30.5 | 32.1 | 44.1 |
-| 550  | Resnet101-FPN | SL1  |       SPM + Distance Cluster-NMS       | 27.5 | 33.5 | 35.9 | 50.2 | 30.4 | 32.0 | 44.3 |
-| 550  | Resnet101-FPN | SL1  | SPM + Distance + Weighted Cluster-NMS  | 26.7 | 34.0 | 36.6 | 49.9 | 30.5 | 32.0 | 44.3 |
+| 550  | Resnet101-FPN | SL1  |                 Fast NMS               |**30.6**|  32.5  |  34.6  |  43.9  |  29.8  |  31.3  |  40.8  |
+| 550  | Resnet101-FPN | SL1  |               Original NMS             |  11.9  |  32.9  |  34.8  |  45.8  |  29.9  |  31.4  |  42.1  |
+| 550  | Resnet101-FPN | SL1  |               Cluster-NMS              |  29.2  |  32.9  |  34.8  |  45.9  |  29.9  |  31.4  |  42.1  |
+| 550  | Resnet101-FPN | SL1  |             SPM Cluster-NMS            |  28.8  |  33.5  |  35.9  |  49.7  |**30.5**|**32.1**|  44.1  |
+| 550  | Resnet101-FPN | SL1  |       SPM + Distance Cluster-NMS       |  27.5  |  33.5  |  35.9  |**50.2**|  30.4  |  32.0  |**44.3**|
+| 550  | Resnet101-FPN | SL1  | SPM + Distance + Weighted Cluster-NMS  |  26.7  |**34.0**|**36.6**|  49.9  |**30.5**|  32.0  |**44.3**|
 
 The following table is evaluated by using their pretrained weighted of YOLACT++. ([yolact_plus_base_54_800000.pth](https://ucdavis365-my.sharepoint.com/:u:/g/personal/yongjaelee_ucdavis_edu/EVQ62sF0SrJPrl_68onyHF8BpG7c05A8PavV4a849sZgEA))
 
 | Image Size | Backbone  | Loss  | NMS  | FPS  | box AP | box AP75 | box AR100 | mask AP | mask AP75 | mask AR100 |
 |:----:|:-------------:|:-------:|:-----------------------------------:|:----:|:----:|:----:|:----:|:----:|:----:|:----:|
-| 550  | Resnet101-FPN | SL1  |                 Fast NMS               | 25.1 | 35.8 | 38.7 | 45.5 | 34.4 | 36.8 | 42.6 |
-| 550  | Resnet101-FPN | SL1  |               Original NMS             | 10.9 | 32.9 | 34.8 | 45.8 | 29.9 | 31.4 | 42.1 |
-| 550  | Resnet101-FPN | SL1  |               Cluster-NMS              | 23.7 | 36.4 | 39.1 | 48.0 | 34.7 | 37.1 | 44.1 |
-| 550  | Resnet101-FPN | SL1  |             SPM Cluster-NMS            | 23.2 | 36.9 | 40.1 | 52.8 | 35.0 | 37.5 | 46.3 |
-| 550  | Resnet101-FPN | SL1  |       SPM + Distance Cluster-NMS       | 22.0 | 36.9 | 40.2 | 53.0 | 34.9 | 37.5 | 46.3 |
-| 550  | Resnet101-FPN | SL1  | SPM + Distance + Weighted Cluster-NMS  | 21.7 | 37.4 | 40.6 | 52.5 | 35.0 | 37.6 | 46.3 |
+| 550  | Resnet101-FPN | SL1  |                 Fast NMS               |**25.1**|  35.8  |  38.7  |  45.5  |  34.4  |  36.8  |  42.6  |
+| 550  | Resnet101-FPN | SL1  |               Original NMS             |  10.9  |  36.4  |  39.1  |  48.0  |  34.7  |  37.1  |  44.1  |
+| 550  | Resnet101-FPN | SL1  |               Cluster-NMS              |  23.7  |  36.4  |  39.1  |  48.0  |  34.7  |  37.1  |  44.1  |
+| 550  | Resnet101-FPN | SL1  |             SPM Cluster-NMS            |  23.2  |  36.9  |  40.1  |  52.8  |**35.0**|  37.5  |**46.3**|
+| 550  | Resnet101-FPN | SL1  |       SPM + Distance Cluster-NMS       |  22.0  |  36.9  |  40.2  |**53.0**|  34.9  |  37.5  |**46.3**|
+| 550  | Resnet101-FPN | SL1  | SPM + Distance + Weighted Cluster-NMS  |  21.7  |**37.4**|**40.6**|  52.5  |**35.0**|**37.6**|**46.3**|
 #### Note:
  - Things we did but did not appear in the paper: SPM + Distance + Weighted Cluster-NMS. Here the box coordinate weighted average is only performed in `IoU> 0.8`. (We searched that `IoU>0.5` is not good for YOLACT and `IoU>0.9` is almost same to `SPM + Distance Cluster-NMS`.)
  - The Original NMS impremented by YOLACT is faster than ours, because they firstly use a score threshold (0.05) to get the set of candidate boxes, then do NMS will be faster (22 ~ 23 FPS with a slight performance drop). In order to get the same result with our Cluster-NMS, we modify the process of Original NMS.