Skip to content

Commit

Permalink
update kitti eval
Browse files Browse the repository at this point in the history
  • Loading branch information
xingyizhou committed May 2, 2019
1 parent d4700b5 commit b1b6991
Show file tree
Hide file tree
Showing 8 changed files with 1,942 additions and 9 deletions.
4 changes: 0 additions & 4 deletions .gitmodules

This file was deleted.

6 changes: 2 additions & 4 deletions readme/GETTING_STARTED.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,12 +50,10 @@ And you can change to other network architectures and resolutions by specifying

### KITTI

To evaluate the kitti dataset, first clone a third-party evaluation tool (if you haven't added `--recursive` when cloning this repo) and compile:
To evaluate the kitti dataset, first compile the evaluation tool (from [here](https://github.com/prclibo/kitti_eval)):

~~~
cd CenterNet_ROOT/src/tools/
git clone https://github.com/prclibo/kitti_eval
cd kitti_eval
cd CenterNet_ROOT/src/tools/kitti_eval
g++ -o evaluate_object_3d_offline evaluate_object_3d_offline.cpp -O3
~~~

Expand Down
2 changes: 1 addition & 1 deletion readme/INSTALL.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ After install Anaconda:
~~~
CenterNet_ROOT=/path/to/clone/CenterNet
git clone --recursive https://github.com/xingyizhou/CenterNet $CenterNet_ROOT
git clone https://github.com/xingyizhou/CenterNet $CenterNet_ROOT
~~~
Expand Down
22 changes: 22 additions & 0 deletions src/tools/kitti_eval/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
# kitti_eval

`evaluate_object_3d_offline.cpp`evaluates your KITTI detection locally on your own computer using your validation data selected from KITTI training dataset, with the following metrics:

- overlap on image (AP)
- oriented overlap on image (AOS)
- overlap on ground-plane (AP)
- overlap in 3D (AP)

Compile `evaluate_object_3d_offline.cpp` with dependency of Boost and Linux `dirent.h` (You should already have it under most Linux).

Run the evalutaion by:

./evaluate_object_3d_offline groundtruth_dir result_dir

Note that you don't have to detect over all KITTI training data. The evaluator only evaluates samples whose result files exist.


### Updates

- June, 2017:
* Fixed the bug of detection box filtering based on min height according to KITTI's note on 25.04.2017.
Loading

0 comments on commit b1b6991

Please sign in to comment.