This repo implements a Topological SLAM: Deep Visual Odometry with Long Term Place Recognition (Loop Closure Detection)

Last update: Jun 23, 2022

Related tags

Overview

Introduction

This repo implements a topological SLAM system. Deep Visual Odometry (DF-VO) and Visual Place Recognition are combined to form the topological SLAM system.

Publications

@INPROCEEDINGS{zhan2019dfvo,
  author={H. {Zhan} and C. S. {Weerasekera} and J. -W. {Bian} and I. {Reid}},
  booktitle={2020 IEEE International Conference on Robotics and Automation (ICRA)}, 
  title={Visual Odometry Revisited: What Should Be Learnt?}, 
  year={2020},
  volume={},
  number={},
  pages={4203-4210},
  doi={10.1109/ICRA40945.2020.9197374}}

@misc{zhan2021dfvo,
      title={DF-VO: What Should Be Learnt for Visual Odometry?}, 
      author={Huangying Zhan and Chamara Saroj Weerasekera and Jia-Wang Bian and Ravi Garg and Ian Reid},
      year={2021},
      eprint={2103.00933},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

@inproceedings{doan2019scalable,
  title={Scalable place recognition under appearance change for autonomous driving},
  author={Doan, Anh-Dzung and Latif, Yasir and Chin, Tat-Jun and Liu, Yu and Do, Thanh-Toan and Reid, Ian},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
  pages={9319--9328},
  year={2019}
}

Part 1. Requirements

This code was tested with Python 3.6, CUDA 10.0, Ubuntu 16.04, and PyTorch-1.0.

We suggest use Anaconda for installing the prerequisites.

cd envs
conda env create -f min_requirements.yml -p {ANACONDA_DIR/envs/topo_slam} # install prerequisites
conda activate topo_slam  # activate the environment [topo_slam]

Part 2. Download dataset and models

The main dataset used in this project is KITTI Driving Dataset. After downloaing the dataset, create a softlink in the current repo.

ln -s KITTI_ODOMETRY/sequences dataset/kitti_odom/odom_data

For our trained models, please visit here to download the models and save the models into the directory model_zoo/.

Part 3. Run example

# run default kitti setup
python main.py -d options/examples/default.yml  -r data/kitti_odom

More configuration examples can be found in configuration examples.

The result (trajectory pose file) is saved in result_dir defined in the configuration file. Please check Configuration Documentation for reference.

Part 4. Result evaluation

Please check here for evaluating the result.

License

Please check License file.

Acknowledgement

Some of the codes were borrowed from the excellent works of monodepth2, LiteFlowNet and pytorch-liteflownet. The borrowed files are licensed under their original license respectively.

This repo implements a Topological SLAM: Deep Visual Odometry with Long Term Place Recognition (Loop Closure Detection)

Related tags

Overview

Introduction

Publications

Demo:

Contents

Part 1. Requirements

Part 2. Download dataset and models

Part 3. Run example

Part 4. Result evaluation

License

Acknowledgement

Owner

Best of Australian Centre for Robotic Vision (ACRV)

ParaMonte is a serial/parallel library of Monte Carlo routines for sampling mathematical objective functions of arbitrary-dimensions

MLOps pipeline project using Amazon SageMaker Pipelines

The easy way to combine mlflow, hydra and optuna into one machine learning pipeline.

A model to predict steering torque fully end-to-end

Lightning ⚡️ fast forecasting with statistical and econometric models.

Code for the TCAV ML interpretability project

Exemplary lightweight and ready-to-deploy machine learning project

Data from "Datamodels: Predicting Predictions with Training Data"

Learn Machine Learning Algorithms by doing projects in Python and R Programming Language

QML: A Python Toolkit for Quantum Machine Learning

Scikit learn library models to account for data and concept drift.

Price Prediction model is used to develop an LSTM model to predict the future market price of Bitcoin and Ethereum.

A toolkit for making real world machine learning and data analysis applications in C++

Short PhD seminar on Machine Learning Security (Adversarial Machine Learning)

MasTrade is a trading bot in baselines3,pytorch,gym

A python library for easy manipulation and forecasting of time series.

A toolbox to iNNvestigate neural networks' predictions!

PyNNDescent is a Python nearest neighbor descent for approximate nearest neighbors.

Azure Cloud Advocates at Microsoft are pleased to offer a 12-week, 24-lesson curriculum all about Machine Learning

A Time Series Library for Apache Spark