QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Last update: Dec 31, 2022

Related tags

Overview

QueryDet-PyTorch

This repository is the official implementation of our paper: QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection

Requirement

a. Install Pytorch 1.4 following here

b. Install APEX following here

c. Install our Pytorch based sparse convolution operation following here

d. Install the detectron2 toolkit following here, note that we build our approach based on version 0.2.1. Note you may follow the instructions to set COCO configs

d. Clone our repository and have fun with it!

Usage

1. Data preparation

a. To prepare MS-COCO, you may follow the instructions of Detectron2

b. We provide the data preprocessing code for VisDrone2018. You need to first download dataset from here

c. Check visdrone/data_prepare.py to process the dataset

2. Training

% train coco RetinaNet baseline
python train_coco.py --config-file models/retinanet/configs/coco/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train coco QueryDet 
python train_coco.py --config-file models/querydet/configs/coco/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train VisDrone RetinaNet baseline
python train_visdrone.py --config-file models/retinanet/configs/visdrone/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train VisDrone QueryDet
python train_visdrone.py --config-file models/querydet/configs/visdrone/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

3. Test

% test coco RetinaNet baseline
python infer_coco.py --config-file models/retinanet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth

% test coco QueryDet with Dense Inference
python infer_coco.py --config-file models/querydet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth

% test coco QueryDet with CSQ
python infer_coco.py --config-file models/querydet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth MODEL.QUERY.QUERY_INFER True

QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Related tags

Overview

QueryDet-PyTorch

Requirement

Usage

1. Data preparation

2. Training

3. Test

Owner

Chenhongyi Yang

Tensorflow implementation of "Learning Deep Features for Discriminative Localization"

This is a virtual picture dragging application. Users may virtually slide photos across the screen. The distance between the index and middle fingers determines the movement. Smaller distances indicate click and motion, whereas bigger distances indicate only hand movement.

Rewrite ultralytics/yolov5 v6.0 opencv inference code based on numpy, no need to rely on pytorch

Code for our ACL 2021 paper "One2Set: Generating Diverse Keyphrases as a Set"

Tutorials and implementations for "Self-normalizing networks"

Pyramid Scene Parsing Network, CVPR2017.

Navigating StyleGAN2 w latent space using CLIP

Motion and Shape Capture from Sparse Markers

Face Detection and Alignment using Multi-task Cascaded Convolutional Networks (MTCNN)

OpenMMLab Detection Toolbox and Benchmark

EfficientNetV2-with-TPU - Cifar-10 case study

Implementation of the bachelor's thesis "Real-time stock predictions with deep learning and news scraping".

NasirKhusraw - The TSP solved using genetic algorithm and show TSP path overlaid on a map of the Iran provinces & their capitals.

Code for "PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation" CVPR 2019 oral

Official PyTorch Implementation of paper EAN: Event Adaptive Network for Efficient Action Recognition

A small demonstration of using WebDataset with ImageNet and PyTorch Lightning

This repo contains the code required to train the multivariate time-series Transformer.

General Vision Benchmark, a project from OpenGVLab

Official implementation of the PICASO: Permutation-Invariant Cascaded Attentional Set Operator

Udacity's CS101: Intro to Computer Science - Building a Search Engine