FairMOT-X is a multi-class multi object tracker based on FairMOT, which has been tailored for training on the BDD100K MOT Dataset. It makes use of YOLOX as the detector from end-to-end, and uses deformable convolutions (DCN) to perform feature fusion of PAFPN outputs for reID embedding learning.
Overview of FairMOT-X Structure
- Modify yolo_head.py for reID branch and reID embedding learning as done in FairMOT
- Prepare dataset in yolomot.py for MOT training, including mosaic implementation
- Finetune training and tracking sequences in yolotrainer.py and YoloTracker.py
- Minor code adjustments for visualisation and writing results to JSON for BDD100K MOT
The following results were recorded after 20 epochs of training. Mosaic augmentation is disabled and L1 detection loss is enabled from epoch 15. FPS is calculated from the average of 200 validation sequences in BDD100K MOT on a single V100 32GB GPU. No pretrained model is used.
| Variant | FPS | mMOTA | mMOTP | mIDF1 |
|---|---|---|---|---|
| YOLOX-S (reID dim 128) | 36.1 | 16.7 | 67.1 | 25.6 |
| YOLOX-M (reID dim 128) | 32.7 | 18.4 | 68.0 | 27.5 |
| YOLOX-L (reID dim 64) | 32.7 | 19.6 | 67.5 | 29.2 |
| YOLOX-L (reID dim 128) | 26.2 | 19.2 | 67.1 | 28.7 |
| YOLOX-L (reID dim 256) | 25.2 | 17.6 | 67.3 | 26.9 |
| YOLOX-X (reID dim 128) | 20.9 | 10.4 | 64.7 | 16.4 |
Please refer to the FairMOT installation instructions to install the required dependencies.
The following command runs training with YOLOX-M as the detector. The corresponding network depth and width must be specified, or the default (YOLOX-L) will be used.
python3 ./src/train.py mot \
--exp_id yolo-m --yolo_depth 0.67 --yolo_width 0.75 \
--lr 7e-4 --lr_step 2 \
--reid_dim 128 --augment --mosaic \
--batch_size 16 --gpus 0
To run the demo after training, you can refer to the following example:
python3 -W ignore ./src/demo.py mot \
--load_model path_to_model.pth \
--input_video path_to_video_or_folder_of_images \
--reid_dim 128 --yolo_depth 0.67 --yolo_width 0.75
This project heavily uses code from YOLOX, the original FairMOT, as well as MCMOT and YOLOv4 MCMOT.