FacePose_pytorch

The pytorch implement of the head pose estimation(yaw,roll,pitch) with SOTA performance in real time.Easy to deploy, easy to use, and high accuracy.

Demo

# install requirements
pip install numpy opencv-python
pip install torch==1.4.0
pip install torchvision==0.5.0


# run the simple inference script
Take a video of face rotation with a computer camera
python video.py --image_name ./video/your_video_name.mp4

Training

There is no need to model train

Introduction

1. Firstly, the Retinaface is used to extract the face frame, and then PFLD is used to identify the key points of the face. Finally, the key points are followed up to estimate the face pose. It is very easy to deploy and use, with high precision and fast speed.
2. We collected our own facial angle conversion data from hundreds of colleagues and fit a simple linear model through the rotation key points of hundreds of people's faces.Experiments show that the simple mathematical linear point model is more efficient and accurate.
3. our program is capable of real-time performance and is able to run from a simple webcam without any specialist hardware.

Performance

# speed
type	Nvidia-V100
fps/s	90

# Angle error(yaw,roll,pitch)
-3°~+3°

Example

TODO

• Training details
• estimate details

FAQ

Q1. Why implement this while there are several FacePose projects already.

A1: Because the existing open source project identification error is large。

Q2: What exactly is the difference among this repository and the others?

A2: For example, Here are some of the common methods used by other open source projects:

1. Dlib:It is not accurate for face key points recognition, and the error is large when the face is rotated or occluded.
2. Virtual 3D model:it is very inaccurate to compare the recognition of key points with a "2D to 3D Virtual fix model",because everyone has a different face.
3. Through the convolution network statistics face key point bitmap, the angle is also very inaccurate.

Q3: What should I do when I find a bug?

A3: Check out the update log if it's been fixed, then pull the latest code to try again. If it doesn't help, create a new issue and describe it in detail.