QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Last update: Dec 31, 2022

Related tags

Overview

QueryDet-PyTorch

This repository is the official implementation of our paper: QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection

Requirement

a. Install Pytorch 1.4 following here

b. Install APEX following here

c. Install our Pytorch based sparse convolution operation following here

d. Install the detectron2 toolkit following here, note that we build our approach based on version 0.2.1. Note you may follow the instructions to set COCO configs

d. Clone our repository and have fun with it!

Usage

1. Data preparation

a. To prepare MS-COCO, you may follow the instructions of Detectron2

b. We provide the data preprocessing code for VisDrone2018. You need to first download dataset from here

c. Check visdrone/data_prepare.py to process the dataset

2. Training

% train coco RetinaNet baseline
python train_coco.py --config-file models/retinanet/configs/coco/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train coco QueryDet 
python train_coco.py --config-file models/querydet/configs/coco/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train VisDrone RetinaNet baseline
python train_visdrone.py --config-file models/retinanet/configs/visdrone/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

% train VisDrone QueryDet
python train_visdrone.py --config-file models/querydet/configs/visdrone/train.yaml --num-gpu 8 OUTPUT_DIR /path/to/workdir

3. Test

% test coco RetinaNet baseline
python infer_coco.py --config-file models/retinanet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth

% test coco QueryDet with Dense Inference
python infer_coco.py --config-file models/querydet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth

% test coco QueryDet with CSQ
python infer_coco.py --config-file models/querydet/configs/coco/test.yaml --num-gpu 8 --eval-only MODEL.WEIGHTS /path/to/workdir/model_final.pth MODEL.QUERY.QUERY_INFER True

QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Related tags

Overview

QueryDet-PyTorch

Requirement

Usage

1. Data preparation

2. Training

3. Test

Owner

Chenhongyi Yang

Deep Residual Networks with 1K Layers

Paddle implementation for "Cross-Lingual Word Embedding Refinement by ℓ1 Norm Optimisation" (NAACL 2021)

Code for "Infinitely Deep Bayesian Neural Networks with Stochastic Differential Equations"

City Surfaces: City-scale Semantic Segmentation of Sidewalk Surfaces

Rethinking the Importance of Implementation Tricks in Multi-Agent Reinforcement Learning

Consistency Regularization for Adversarial Robustness

Code for generating the figures in the paper "Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?"

Real-time Neural Representation Fusion for Robust Volumetric Mapping

Контрольная работа по математическим методам машинного обучения

Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".

Generate Cartoon Images using Generative Adversarial Network

Supervised domain-agnostic prediction framework for probabilistic modelling

Normal Learning in Videos with Attention Prototype Network

Using this codebase as a tool for my own research. Making some modifications to the original repo for my own purposes.

Code for CPM-2 Pre-Train

利用Tensorflow实现基于CNN的中文短文本分类

A clean and extensible PyTorch implementation of Masked Autoencoders Are Scalable Vision Learners

Consumer Fairness in Recommender Systems: Contextualizing Definitions and Mitigations

This repository contains the code for the CVPR 2020 paper "Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision"

Code for intrusion detection system (IDS) development using CNN models and transfer learning