[Modelzoo] Update stand-alone performance and accuracy data. (DeepRec…

…-AI#214)
15861329502 · May 12, 2022 · 205b385 · 205b385
1 parent a639e36
commit 205b385
Show file tree

Hide file tree

Showing 6 changed files with 53 additions and 53 deletions.
diff --git a/modelzoo/DIEN/README.md b/modelzoo/DIEN/README.md
@@ -166,23 +166,23 @@ The benchmark is performed on the [Alibaba Cloud ECS general purpose instance fa
         <td rowspan="3">DIEN</td>
         <td>Community TensorFlow</td>
         <td>FP32</td>
-        <td>0.655367</td>
-        <td>0.686955</td>
-        <td>2826.36(baseline)</td>
+        <td>0.681824</td>
+        <td>0.757496</td>
+        <td>2822.78(baseline)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32</td>
-        <td>0.67798</td>
-        <td>0.717945</td>
-        <td>3844.73(1.36x)</td>
+        <td>0.692499</td>
+        <td>0.767193</td>
+        <td>3834.05(1.36x)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32+BF16</td>
-        <td>0.673954</td>
-        <td>0.713831</td>
-        <td>3869.78(1.37x)</td>
+        <td>0.693011</td>
+        <td>0.768412</td>
+        <td>3862.06(1.37x)</td>
     </tr>
 </table>
 

diff --git a/modelzoo/DIN/README.md b/modelzoo/DIN/README.md
@@ -163,22 +163,22 @@ The benchmark is performed on the [Alibaba Cloud ECS general purpose instance fa
         <td rowspan="3">DIN</td>
         <td>Community TensorFlow</td>
         <td>FP32</td>
-        <td>0.626609</td>
-        <td>0.655082</td>
-        <td>10403.01(baseline)</td>
+        <td>0.68156</td>
+        <td>0.757246</td>
+        <td>10474.23(baseline)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32</td>
-        <td>0.664656</td>
-        <td>0.703606</td>
-        <td>22422.64(2.16x)</td>
+        <td>0.692483</td>
+        <td>0.767444</td>
+        <td>22299.68(2.13x)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32+BF16</td>
-        <td>0.665547</td>
-        <td>0.701519</td>
+        <td>0.694471</td>
+        <td>0.770365</td>
         <td></td>
     </tr>
 </table>

diff --git a/modelzoo/DLRM/README.md b/modelzoo/DLRM/README.md
@@ -174,23 +174,23 @@ The benchmark is performed on the [Alibaba Cloud ECS general purpose instance fa
         <td rowspan="3">DLRM</td>
         <td>Community TensorFlow</td>
         <td>FP32</td>
-        <td>0.778858</td>
-        <td>0.77024</td>
-        <td>34383.52(baseline)</td>
+        <td>0.782930</td>
+        <td>0.780513</td>
+        <td>34617.94(baseline)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32</td>
-        <td>0.780382</td>
-        <td>0.770818</td>
-        <td>58637.40(1.71x)</td>
+        <td>0.783274</td>
+        <td>0.780988</td>
+        <td>59067.85(1.71x)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32+BF16</td>
-        <td>0.78029</td>
-        <td>0.773521</td>
-        <td> </td>
+        <td>0.783428</td>
+        <td>0.780825</td>
+        <td>60907.11(1.76x)</td>
     </tr>
 </table>
 

diff --git a/modelzoo/DSSM/README.md b/modelzoo/DSSM/README.md
@@ -178,23 +178,23 @@ The benchmark is performed on the [Alibaba Cloud ECS general purpose instance fa
         <td rowspan="3">DSSM</td>
         <td>Community TensorFlow</td>
         <td>FP32</td>
-        <td>0.8938</td>
-        <td>0.497571</td>
-        <td>74699.90(baseline)</td>
+        <td>0.913399</td>
+        <td>0.503494</td>
+        <td>75906.95(baseline)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32</td>
-        <td>0.904799</td>
-        <td>0.504635</td>
-        <td>114436.87(1.53x)</td>
+        <td>0.9079</td>
+        <td>0.492405</td>
+        <td>115607.72(1.52x)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32+BF16</td>
-        <td>0.901099</td>
-        <td>0.505794</td>
-        <td>125995.83(1.69x)</td>
+        <td>0.9265</td>
+        <td>0.484328</td>
+        <td>129099.08(1.70x)</td>
     </tr>
 </table>
 

diff --git a/modelzoo/DeepFM/README.md b/modelzoo/DeepFM/README.md
@@ -181,23 +181,23 @@ The benchmark is performed on the [Alibaba Cloud ECS general purpose instance fa
         <td rowspan="3">DeepFM</td>
         <td>Community TensorFlow</td>
         <td>FP32</td>
-        <td>0.783646</td>
-        <td>0.781459</td>
-        <td>18765.95(baseline)</td>
+        <td>0.784695</td>
+        <td>0.781548</td>
+        <td>18848.64(baseline)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32</td>
-        <td>0.786496</td>
-        <td>0.785583</td>
-        <td>30718.60(1.64x)</td>
+        <td>0.782755</td>
+        <td>0.777158</td>
+        <td>31260.00(1.65x)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32+BF16</td>
-        <td>0.786195</td>
-        <td>0.784967</td>
-        <td>34554.67(1.84x)</td>
+        <td>0.782659</td>
+        <td>0.776537</td>
+        <td>34627.46(1.84x)</td>
     </tr>
 </table>
 

diff --git a/modelzoo/WDL/README.md b/modelzoo/WDL/README.md
@@ -194,23 +194,23 @@ The benchmark is performed on the [Alibaba Cloud ECS general purpose instance fa
         <td rowspan="3">WDL</td>
         <td>Community TensorFlow</td>
         <td>FP32</td>
-        <td>0.773347</td>
-        <td>0.761744</td>
-        <td>8685.99(baseline)</td>
+        <td>0.770078</td>
+        <td>0.749524</td>
+        <td>8786.04(baseline)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32</td>
-        <td>0.775656</td>
-        <td>0.765537</td>
-        <td>15792.49(1.81x)</td>
+        <td>0.771792</td>
+        <td>0.759774</td>
+        <td>16393.65(1.86x)</td>
     </tr>
     <tr>
         <td>DeepRec w/ oneDNN</td>
         <td>FP32+BF16</td>
-        <td>0.773179</td>
-        <td>0.761081</td>
-        <td>22633.80(2.61x)</td>
+        <td>0.774918</td>
+        <td>0.767013</td>
+        <td>22788.93(2.59x)</td>
     </tr>
 </table>