Intermediate Domain Module (IDM)
This repository is the official implementation for IDM: An Intermediate Domain Module for Domain Adaptive Person Re-ID, which is accepted by ICCV 2021 (Oral).
IDM achieves state-of-the-art performances on the unsupervised domain adaptation task for person re-ID.
Requirements
Installation
git clone https://github.com/SikaStar/IDM.git
cd IDM/idm/evaluation_metrics/rank_cylib && make all
Prepare Datasets
cd examples && mkdir data
Download the person re-ID datasets Market-1501, DukeMTMC-ReID, MSMT17, PersonX, and UnrealPerson. Then unzip them under the directory like
IDM/examples/data
├── dukemtmc
│ └── DukeMTMC-reID
├── market1501
│ └── Market-1501-v15.09.15
├── msmt17
│ └── MSMT17_V1
├── personx
│ └── PersonX
└── unreal
├── list_unreal_train.txt
└── unreal_vX.Y
Prepare ImageNet Pre-trained Models for IBN-Net
When training with the backbone of IBN-ResNet, you need to download the ImageNet-pretrained model from this link and save it under the path of logs/pretrained/.
mkdir logs && cd logs
mkdir pretrained
The file tree should be
IDM/logs
└── pretrained
└── resnet50_ibn_a.pth.tar
ImageNet-pretrained models for ResNet-50 will be automatically downloaded in the python script.
Training
We utilize 4 GTX-2080TI GPUs for training. Note that
- The source and target domains are trained jointly.
- For baseline methods, use
-a resnet50for the backbone of ResNet-50, and-a resnet_ibn50afor the backbone of IBN-ResNet. - For IDM, use
-a resnet50_idmto insert IDM into the backbone of ResNet-50, and-a resnet_ibn50a_idmto insert IDM into the backbone of IBN-ResNet. - For strong baseline, use
--use-xbmto implement XBM (a variant of Memory Bank).
Baseline Methods
To train the baseline methods in the paper, run commands like:
# Naive Baseline
CUDA_VISIBLE_DEVICES=0,1,2,3 sh scripts/run_naive_baseline.sh ${source} ${target} ${arch}
# Strong Baseline
CUDA_VISIBLE_DEVICES=0,1,2,3 sh scripts/run_strong_baseline.sh ${source} ${target} ${arch}
Some examples:
### market1501 -> dukemtmc ###
# ResNet-50
CUDA_VISIBLE_DEVICES=0,1,2,3 sh scripts/run_strong_baseline.sh market1501 dukemtmc resnet50
# IBN-ResNet-50
CUDA_VISIBLE_DEVICES=0,1,2,3 sh scripts/run_strong_baseline.sh market1501 dukemtmc resnet_ibn50a
Training with IDM
To train the models with our IDM, run commands like:
# Naive Baseline + IDM
CUDA_VISIBLE_DEVICES=0,1,2,3 \
sh scripts/run_idm.sh ${source} ${target} ${arch} ${stage} ${mu1} ${mu2} ${mu3}
# Strong Baseline + IDM
CUDA_VISIBLE_DEVICES=0,1,2,3 \
sh scripts/run_idm_xbm.sh ${source} ${target} ${arch} ${stage} ${mu1} ${mu2} ${mu3}
- Defaults:
--stage 0 --mu1 0.7 --mu2 0.1 --mu3 1.0
Some examples:
### market1501 -> dukemtmc ###
# ResNet-50 + IDM
CUDA_VISIBLE_DEVICES=0,1,2,3 \
sh scripts/run_idm_xbm.sh market1501 dukemtmc resnet50_idm 0 0.7 0.1 1.0
# IBN-ResNet-50 + IDM
CUDA_VISIBLE_DEVICES=0,1,2,3 \
sh scripts/run_idm_xbm.sh market1501 dukemtmc resnet_ibn50a_idm 0 0.7 0.1 1.0
Evaluation
We utilize 1 GTX-2080TI GPU for testing. Note that
- use
--dsbnfor domain adaptive models, and add--test-sourceif you want to test on the source domain; - use
-a resnet50for the backbone of ResNet-50, and-a resnet_ibn50afor the backbone of IBN-ResNet. - use
-a resnet50_idmfor ResNet-50 + IDM, and-a resnet_ibn50a_idmfor IBN-ResNet + IDM.
To evaluate the baseline model on the target-domain dataset, run:
CUDA_VISIBLE_DEVICES=0 \
python3 examples/test.py --dsbn -d ${dataset} -a ${arch} --resume ${resume}
To evaluate the baseline model on the source-domain dataset, run:
CUDA_VISIBLE_DEVICES=0 \
python3 examples/test.py --dsbn --test-source -d ${dataset} -a ${arch} --resume ${resume}
To evaluate the IDM model on the target-domain dataset, run:
CUDA_VISIBLE_DEVICES=0 \
python3 examples/test.py --dsbn-idm -d ${dataset} -a ${arch} --resume ${resume} --stage ${stage}
To evaluate the IDM model on the source-domain dataset, run:
CUDA_VISIBLE_DEVICES=0 \
python3 examples/test.py --dsbn-idm --test-source -d ${dataset} -a ${arch} --resume ${resume} --stage ${stage}
Some examples:
### market1501 -> dukemtmc ###
# evaluate the target domain "dukemtmc" on the strong baseline model
CUDA_VISIBLE_DEVICES=0 \
python3 examples/test.py --dsbn -d dukemtmc -a resnet50 \
--resume logs/resnet50_strong_baseline/market1501-TO-dukemtmc/model_best.pth.tar
# evaluate the source domain "market1501" on the strong baseline model
CUDA_VISIBLE_DEVICES=0 \
python3 examples/test.py --dsbn --test-source -d market1501 -a resnet50 \
--resume logs/resnet50_strong_baseline/market1501-TO-dukemtmc/model_best.pth.tar
# evaluate the target domain "dukemtmc" on the IDM model (after stage-0)
python3 examples/test.py --dsbn-idm -d dukemtmc -a resnet50_idm \
--resume logs/resnet50_idm_xbm/market1501-TO-dukemtmc/model_best.pth.tar --stage 0
# evaluate the target domain "dukemtmc" on the IDM model (after stage-0)
python3 examples/test.py --dsbn-idm --test-source -d market1501 -a resnet50_idm \
--resume logs/resnet50_idm_xbm/market1501-TO-dukemtmc/model_best.pth.tar --stage 0
Acknowledgement
Our code is based on MMT and SpCL. Thanks for Yixiao's wonderful works.
Citation
If you find our work is useful for your research, please kindly cite our paper
@inproceedings{dai2021idm,
title={IDM: An Intermediate Domain Module for Domain Adaptive Person Re-ID},
author={Dai, Yongxing and Liu, Jun and Sun, Yifan and Tong, Zekun and Zhang, Chi and Duan, Ling-Yu},
booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
year={2021}
}
If you have any questions, please leave an issue or contact me: [email protected]
759 Jan 08, 2023
111 Dec 31, 2022
1 Dec 14, 2021
9 Nov 28, 2022
3k Jan 07, 2023
25 Dec 30, 2022
6 Oct 07, 2022
83 Nov 29, 2022
40 Aug 31, 2022
4 Nov 18, 2021
3 Apr 09, 2022
1.6k Dec 28, 2022
340 Dec 30, 2022
906 Jan 04, 2023
180 Jan 07, 2023
10 May 05, 2022
568 Dec 14, 2022
529 Jan 02, 2023
47 Dec 30, 2022
14 Nov 06, 2022