Pedestrian Cell Phone Usage Detection

Alias: YOU FOCUS YOUR WALK

Personnel

• Group Members: Mai Jiajun, Huang Yanzhen
• Supervisor: Prof. Bob Zhang

License

This repository contains components licensed under different licenses. The full texts are available in the LICENSES directory.

Component	Type	LICENSE File (Local)	Source (with License)
Open-MMLab	Apache-2.0	LICENSES/Apache_Open-MMLab/LICENSE.txt	https://github.com/open-mmlab
ultralytics	AGPL-3.0	LICENSES/AGPL_ultralytics/LICENSE.txt	https://github.com/ultralytics/ultralytics

More credits and copyrights info about ultralycis is in main.py.

Configure Project

A quick start: The entry of this project is main.py. Come back and run this file when you are done configuring.

Step 0. Conda

Please make sure that you are under the conda environment. If you are not, please do the following in the anaconda prompt terminal:

0.1 Create Virtual Environment

conda create --prefix <PATH_TO_YOUR_VENV_ROOT_FOLDER> python=3.8 -y

0.2 Activate Virtual Environment

conda activate <PATH_TO_YOUR_VENV_ROOT_FOLDER>

0.3 Go to Project Dir

cd <PATH_TO_YOUR_CLONED_PROJECT>

Step 1. Install Pytorch

We have inspected that mmcv does not work with pytorch with a higher version. Under a higher torch version, cuda:0 is not available, eventhough torch.cuda.is_available() returns True.

According to this issue: open-mmlab/mmdetection#11530 (comment), mmcv only works with pytorch with version 2.1.0. And it has been confirmed by us. Please run:

conda install pytorch==2.1.0 torchvision==0.16.0 torchaudio==2.1.0 pytorch-cuda=11.8 -c pytorch -c nvidia

You should have these installed:

Package	Build
pytorch-2.1.0	py3.8_cuda11.8_cudnn8_0
torchaudio-2.1.0	py38_cu118
torchvision-0.16.0	py38_cu118

2. Install MM Packages

2.1 Openmim

After activating your conda environment, pleas install openmim package manager. For Windows users, please run:

<PATH_TO_YOUR_VIRTUAL_ENVIRONMENT>/Scripts/pip.exe install -U openmim

For Mac users, please run:

<PATH_TO_YOUR_VIRTUAL_ENVIRONMENT>/bin/pip install -U openmim

The absolute path to your pip executable is preferred to ensure that you have used the correct pip. Using a wrong instance of pip will cause your packages to be downloaded to the wrong environment.

2.2 MM Packages

There are four MM packages you need to install. Please install the EXACT version listed in the form below. This is the best solution we could get to prevent package conflicts. For more information, please visit https://mmcv.readthedocs.io/en/latest/get_started/installation.html.

Package	Version	Source
mmcv	2.1.0	https://github.com/open-mmlab/mmcv
mmdet	3.2.0	https://github.com/open-mmlab/mmdetection
mmengine	0.10.4	https://github.com/open-mmlab/mmengine
mmpose	1.3.2	https://github.com/open-mmlab/mmpose

Run this command to install MM related packages:

mim install "mmcv==2.1.0" "mmdet==3.2.0" "mmengine==0.10.4" "mmpose==1.3.2"

If you encounter an error while installing mmcv like this:

error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/

You are missing a C++ requirement. Please download C++ build tools using the given link, and configure a C++ environment. Please inspect this link for more details about C++ environment configuration: https://blog.csdn.net/xiao_yan_/article/details/119538602.

This is highly-likely a windows-only problem, considering macOS has its own gcc. If you use a mac and also received similar errors, please don't hesitate to propose an issue.

2.3 Checkpoint & Configuration Files

For both boundary detection and pose estimation, there are two kinds of files: Config files and Checkpoint files.

Please download all of them by clicking these links:

.py Files (No longer need manual downloading)

You can skip this step, since the config .py files have been re-included into the GitHub repo, in model_config/configs. However, you can still choose to download them from URLs listed below.

• config files (.py):
  • det config (boundary detection): https://github.com/open-mmlab/mmpose/blob/dev-1.x/projects/rtmpose/rtmdet/person/rtmdet_nano_320-8xb32_coco-person.py
  • pose config (pose estimation): https://github.com/open-mmlab/mmpose/blob/dev-1.x/projects/rtmpose/rtmpose/body_2d_keypoint/rtmpose-t_8xb256-420e_coco-256x192.py

After downloading from the browser, please move them into model_config/configs/. You may need to create this folder first.

.pth Files

The below downloading method is too slow in efficiency. We have put all the available configurations in our Google Drive. Link: https://drive.google.com/drive/folders/1Jsjhnrq4tJselSn-zU-yulNmpRycgSu2?usp=sharing. Please download ALL of them and put them in model_config/checkpoints/, where the contents in this folder are ignored. If you prefer to download from source, please refer to the links below.

• checkpoint files (.pth):
  • det checkpoint: https://download.openmmlab.com/mmpose/v1/projects/rtmpose/rtmdet_nano_8xb32-100e_coco-obj365-person-05d8511e.pth
  • pose checkpoint: https://download.openmmlab.com/mmpose/v1/projects/rtmposev1/rtmpose-tiny_simcc-aic-coco_pt-aic-coco_420e-256x192-cfc8f33d_20230126.pth

After downloading from the browser, please move them into model_config/checkpoints/. You may need to create this folder first.

3. Regular Packages

Run the following command to install regular required packages.

For windows:

<PATH_TO_YOUR_VIRTUAL_ENVIRONMENT>/Scripts/pip.exe install -r requirements.txt

Try to run main.py. If an error regarding opencv-python occurred, uninstall it and re-install it again.

<PATH_TO_YOUR_VIRTUAL_ENVIRONMENT>/Scripts/pip.exe uninstall opencv-python

<PATH_TO_YOUR_VIRTUAL_ENVIRONMENT>/Scripts/pip.exe install opencv-python