A synthetic texture-invariant dataset for object detection of UAVs

Last update: Aug 13, 2022

Overview

A synthetic dataset for object detection of UAVs

This repository contains a synthetic datasets accompanying the paper Sim2Air - Synthetic aerial dataset for UAV monitoring by Antonella Barisic, Frano Petric and Stjepan Bogdan.

In this paper, we propose to use a texture-invariant representation of objects for aerial object detection. Our approach improves the generalisation and robustness of the object detector. A dataset is created with randomly assigned atypical textures and sufficient diversity and photorealism in all other components such as shape, pose, lighting, scale, background, etc. The results also show improved accuracy in case of distant objects and difficult lighting conditions.

All datasets from the paper are available for download. If you use these datasets for your research, please cite:

@misc{barisic2021sim2air,
      title={Sim2Air - Synthetic aerial dataset for UAV monitoring}, 
      author={Antonella Barisic and Frano Petric and Stjepan Bogdan},
      year={2021},
      eprint={2110.05145},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Datasets

Name	Description
Synthetic Eagle Baseline (SEB)	The SEB dataset is a synthetic dataset with a single UAV model, the custom aerial platform Eagle. Since this dataset serves as the basis for proving our hypothesis, it was created with only one texture, identical to the texture of real-life Eagle. SEB consists of 32 000 images of size 604 x 604 with annotations in YOLO format.
Synthetic Eagle with Textures (SET)	The SET dataset is the main star ⭐ of our work. It is a synthetic dataset of a single model, the custom aerial platform Eagle, with randomly selected atypical textures. The mixture of 32 different textures is applied during the procedural generation of the dataset. SET also consists of 32 000 images of size 604 x 604 with annotations in YOLO format.
Synthetic UAVs with Textures (S-UAV-T)	The S-UAV-T dataset is similar to SET but with many more models of UAVs. The data was created with 10 different multicopter models, 32 atypical textures, and with a variety of poses, backgrounds, viewpoints, etc. S-UAV-T consists of 52 500 images of size 604 x 604 with annotations in YOLO format.

If you want to test your detection results against real data, check out our UAV-Eagle dataset at larics/UAV-Eagle.

Contact

For more information, please contact Antonella Barisic.

A synthetic texture-invariant dataset for object detection of UAVs

Related tags

Overview

A synthetic dataset for object detection of UAVs

Datasets

Contact

Owner

LARICS Lab

3rd Place Solution for ICCV 2021 Workshop SSLAD Track 3A - Continual Learning Classification Challenge

Codecov coverage standard for Python

GLANet - The code for Global and Local Alignment Networks for Unpaired Image-to-Image Translation arxiv

Harmonious Textual Layout Generation over Natural Images via Deep Aesthetics Learning

Online Multi-Granularity Distillation for GAN Compression (ICCV2021)

Short and long time series classification using convolutional neural networks

Code for the ICASSP-2021 paper: Continuous Speech Separation with Conformer.

The project is an official implementation of our CVPR2019 paper "Deep High-Resolution Representation Learning for Human Pose Estimation"

Multi-layer convolutional LSTM with Pytorch

Stacked Generative Adversarial Networks

An AFL implementation with UnTracer (our coverage-guided tracer)

a curated list of docker-compose files prepared for testing data engineering tools, databases and open source libraries.

[NeurIPS 2021] "Delayed Propagation Transformer: A Universal Computation Engine towards Practical Control in Cyber-Physical Systems"

PyTorch implementation of Federated Learning with Non-IID Data, and federated learning algorithms, including FedAvg, FedProx.

N-gram models- Unsmoothed, Laplace, Deleted Interpolation

This repository contains the implementation of the paper: Federated Distillation of Natural Language Understanding with Confident Sinkhorns

Dynamic wallpaper generator.

Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes

Code release for "Making a Bird AI Expert Work for You and Me".

【CVPR 2021, Variational Inference Framework, PyTorch】 From Rain Generation to Rain Removal