sample deploy app using onnxruntime

---

This sample uses Cpp api of onnxruntime.

Dependencies

---

• onnxruntime

  • tested with v1.10.0
  • to build onnxruntime from source you need cmake>=3.18
  • you can build from source with the build script
  • here is the sample procedure to build cpu onnxruntime

    readonly ONNXRUNTIME_VERSION="v1.10.0"
    git clone --recursive -b ${ONNXRUNTIME_VERSION} https://github.com/Microsoft/onnxruntime
    ./build.sh --config RelWithDebInfo --build_shared_lib --skip_tests --parallel `nproc`
    cd build/Linux/RelWithDebInfo
    make install

• opencv

sudo apt-get install libopencv-dev

How to Build

---

mkdir build && cd build && cmake ../ && make -j`nproc`

How to Run

---

• Download test images

wget https://paddleseg.bj.bcebos.com/dygraph/demo/cityscapes_demo.png

• Export PaddleSeg Model to onnx format

  • export PaddleSeg model
  • convert exported model to onnx format with Paddle2ONNX

• You can download the bisenetv2 onnx model for this demo directly from the following url:

wget https://github.com/PaddlePaddle/PaddleSeg/files/7918707/bisenetv2_cityscapes.zip && unzip bisenetv2_cityscapes.zip

• Run app

./build/onnxruntime_cpp_inference_demo_app /path/to/test/image /path/to/onnx/model

The result will be saved as out_img.jpg