This document gives the prediction time-consuming benchmark of PaddleOCR Ultra Lightweight Chinese Model (8.6M) on each platform.
- 500 images were randomly sampled from the Chinese public data set ICDAR2017-RCTW. Most of the pictures in the set were collected in the wild through mobile phone cameras. Some are screenshots. These pictures show various scenes, including street scenes, posters, menus, indoor scenes and screenshots of mobile applications.
The predicted time-consuming indicators on the four platforms are as follows:
Long size(px) | T4(s) | V100(s) | Intel Xeon 6148(s) | Snapdragon 855(s) |
---|---|---|---|---|
960 | 0.092 | 0.057 | 0.319 | 0.354 |
640 | 0.067 | 0.045 | 0.198 | 0.236 |
480 | 0.057 | 0.043 | 0.151 | 0.175 |
Explanation:
-
The evaluation time-consuming stage is the complete stage from image input to result output, including image pre-processing and post-processing.
-
Intel Xeon 6148
is the server-side CPU model. Intel MKL-DNN is used in the test to accelerate the CPU prediction speed. To use this operation, you need to:- Update to the latest version of PaddlePaddle: https://www.paddlepaddle.org.cn/documentation/docs/zh/install/Tables.html#whl-dev Please select the corresponding mkl version wheel package according to the CUDA version and Python version of your environment, for example, CUDA10, Python3.7 environment, you should:
# Obtain the installation package wget https://paddle-wheel.bj.bcebos.com/0.0.0-gpu-cuda10-cudnn7-mkl/paddlepaddle_gpu-0.0.0-cp37-cp37m-linux_x86_64.whl # Installation pip3.7 install paddlepaddle_gpu-0.0.0-cp37-cp37m-linux_x86_64.whl
- Use parameters
--enable_mkldnn True
to turn on the acceleration switch when making predictions
-
Snapdragon 855
is a mobile processing platform model.