A synthetic texture-invariant dataset for object detection of UAVs

Overview

eagle_005

A synthetic dataset for object detection of UAVs

This repository contains a synthetic datasets accompanying the paper Sim2Air - Synthetic aerial dataset for UAV monitoring by Antonella Barisic, Frano Petric and Stjepan Bogdan.

In this paper, we propose to use a texture-invariant representation of objects for aerial object detection. Our approach improves the generalisation and robustness of the object detector. A dataset is created with randomly assigned atypical textures and sufficient diversity and photorealism in all other components such as shape, pose, lighting, scale, background, etc. The results also show improved accuracy in case of distant objects and difficult lighting conditions.

All datasets from the paper are available for download. If you use these datasets for your research, please cite:

@misc{barisic2021sim2air,
      title={Sim2Air - Synthetic aerial dataset for UAV monitoring}, 
      author={Antonella Barisic and Frano Petric and Stjepan Bogdan},
      year={2021},
      eprint={2110.05145},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Datasets

Name Description
Synthetic Eagle Baseline (SEB) The SEB dataset is a synthetic dataset with a single UAV model, the custom aerial platform Eagle. Since this dataset serves as the basis for proving our hypothesis, it was created with only one texture, identical to the texture of real-life Eagle. SEB consists of 32 000 images of size 604 x 604 with annotations in YOLO format.
Synthetic Eagle with Textures (SET) The SET dataset is the main star of our work. It is a synthetic dataset of a single model, the custom aerial platform Eagle, with randomly selected atypical textures. The mixture of 32 different textures is applied during the procedural generation of the dataset. SET also consists of 32 000 images of size 604 x 604 with annotations in YOLO format.
Synthetic UAVs with Textures (S-UAV-T) The S-UAV-T dataset is similar to SET but with many more models of UAVs. The data was created with 10 different multicopter models, 32 atypical textures, and with a variety of poses, backgrounds, viewpoints, etc. S-UAV-T consists of 52 500 images of size 604 x 604 with annotations in YOLO format.

If you want to test your detection results against real data, check out our UAV-Eagle dataset at larics/UAV-Eagle.

Contact

For more information, please contact Antonella Barisic.

Owner
LARICS Lab
LARICS Lab
Machine Learning in Asset Management (by @firmai)

Machine Learning in Asset Management If you like this type of content then visit ML Quant site below: https://www.ml-quant.com/ Part One Follow this l

Derek Snow 1.5k Jan 02, 2023
Hypercomplex Neural Networks with PyTorch

HyperNets Hypercomplex Neural Networks with PyTorch: this repository would be a container for hypercomplex neural network modules to facilitate resear

Eleonora Grassucci 21 Dec 27, 2022
Implementation for Simple Spectral Graph Convolution in ICLR 2021

Simple Spectral Graph Convolutional Overview This repo contains an example implementation of the Simple Spectral Graph Convolutional (S^2GC) model. Th

allenhaozhu 64 Dec 31, 2022
Official project repository for 'Normality-Calibrated Autoencoder for Unsupervised Anomaly Detection on Data Contamination'

NCAE_UAD Official project repository of 'Normality-Calibrated Autoencoder for Unsupervised Anomaly Detection on Data Contamination' Abstract In this p

Jongmin Andrew Yu 2 Feb 10, 2022
Probabilistic Entity Representation Model for Reasoning over Knowledge Graphs

Implementation for the paper: Probabilistic Entity Representation Model for Reasoning over Knowledge Graphs, Nurendra Choudhary, Nikhil Rao, Sumeet Ka

Nurendra Choudhary 8 Nov 15, 2022
ProFuzzBench - A Benchmark for Stateful Protocol Fuzzing

ProFuzzBench - A Benchmark for Stateful Protocol Fuzzing ProFuzzBench is a benchmark for stateful fuzzing of network protocols. It includes a suite of

155 Jan 08, 2023
Wenet STT Python

Wenet STT Python Beta Software Simple Python library, distributed via binary wheels with few direct dependencies, for easily using WeNet models for sp

David Zurow 33 Feb 21, 2022
Official code for our CVPR '22 paper "Dataset Distillation by Matching Training Trajectories"

Dataset Distillation by Matching Training Trajectories Project Page | Paper This repo contains code for training expert trajectories and distilling sy

George Cazenavette 256 Jan 05, 2023
PyTorch implementation of the cross-modality generative model that synthesizes dance from music.

Dancing to Music PyTorch implementation of the cross-modality generative model that synthesizes dance from music. Paper Hsin-Ying Lee, Xiaodong Yang,

NVIDIA Research Projects 485 Dec 26, 2022
TensorRT examples (Jetson, Python/C++)(object detection)

TensorRT examples (Jetson, Python/C++)(object detection)

Nobuo Tsukamoto 53 Dec 22, 2022
PyTorch implementation for View-Guided Point Cloud Completion

PyTorch implementation for View-Guided Point Cloud Completion

22 Jan 04, 2023
Finding Donors for CharityML

Finding-Donors-for-CharityML - Investigated factors that affect the likelihood of charity donations being made based on real census data.

Moamen Abdelkawy 1 Dec 30, 2021
Official PyTorch implementation of "Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-supervised Action Recognition" in AAAI2022.

AimCLR This is an official PyTorch implementation of "Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-supervised Action Reco

Gty 44 Dec 17, 2022
Cossim - Sharpened Cosine Distance implementation in PyTorch

Sharpened Cosine Distance PyTorch implementation of the Sharpened Cosine Distanc

Istvan Fehervari 10 Mar 22, 2022
U-2-Net: U Square Net - Modified for paired image training of style transfer

U2-Net: U Square Net Modified for paired image training of style transfer This is an unofficial repo making use of the code which was made available b

Doron Adler 43 Oct 03, 2022
Implementation of popular SOTA self-supervised learning algorithms as Fastai Callbacks.

Self Supervised Learning with Fastai Implementation of popular SOTA self-supervised learning algorithms as Fastai Callbacks. Install pip install self-

Kerem Turgutlu 276 Dec 23, 2022
DPT: Deformable Patch-based Transformer for Visual Recognition (ACM MM2021)

DPT This repo is the official implementation of DPT: Deformable Patch-based Transformer for Visual Recognition (ACM MM2021). We provide code and model

CASIA-IVA-Lab 111 Dec 21, 2022
A light-weight image labelling tool for Python designed for creating segmentation data sets.

An image labelling tool for creating segmentation data sets, for Django and Flask.

117 Nov 21, 2022
Benchmarking the robustness of Spatial-Temporal Models

Benchmarking the robustness of Spatial-Temporal Models This repositery contains the code for the paper Benchmarking the Robustness of Spatial-Temporal

Yi Chenyu Ian 15 Dec 16, 2022
Code repo for realtime multi-person pose estimation in CVPR'17 (Oral)

Realtime Multi-Person Pose Estimation By Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh. Introduction Code repo for winning 2016 MSCOCO Keypoints Cha

Zhe Cao 4.9k Dec 31, 2022