RL-GAN: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation

Last update: Nov 10, 2022

Related tags

Overview

RL-GAN: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation

RL-GAN is an official implementation of the paper: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation.

Paper

Shani Gamrian, Yoav Goldberg, "Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation"

@article{DBLP:journals/corr/abs-1806-07377,
  author    = {Shani Gamrian and
               Yoav Goldberg},
  title     = {Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image
               Translation},
  journal   = {CoRR},
  volume    = {abs/1806.07377},
  year      = {2018},
  url       = {http://arxiv.org/abs/1806.07377},
  archivePrefix = {arXiv},
  eprint    = {1806.07377},
  timestamp = {Mon, 13 Aug 2018 16:48:23 +0200},
  biburl    = {https://dblp.org/rec/bib/journals/corr/abs-1806-07377},
  bibsource = {dblp computer science bibliography, https://dblp.org}
}

Videos:

Breakout

RoadFighter

Installation

The code was tested on Ubuntu 16.04 with Python 3.6
Install packages by typing the command: pip install -r requirements.txt.
For Road Fighter, clone and install the repo: https://github.com/ShaniGam/retro

Getting Started

Breakout Examples

Train Breakout from scratch:

python -m breakout_a3c.main --num-processes 32 --variation 'standart'

Transfer from standart to diagonals variation and fine-tune the model:

python -m breakout_a3c.main --num-processes 32 --variation diagonals --ft-setting full-ft --test

Collect images for UNIT training:

python -m breakout_a3c.main --collect-images --num-collected-imgs 100000 --variation diagonals --num-processes 1

Train UNIT:

python -m unit.train --trainer UNIT --config unit/configs/breakout-diagonals.yaml

Run Breakout with UNIT:

python -m breakout_a3c.main --variation diagonals --test --ft-setting full-ft --test-gan --gan-dir breakout-diagonals --num-processes 0

Road Fighter Examples

Train level 1 of Road Fighter

python -m roadfighter_a2c.main --num-processes 84

Collect images for UNIT training:

python -m roadfighter_a2c.main -level 1 --collect-images --num-collected-imgs 100000 --num-processes 1
python -m roadfighter_a2c.main -level 2 --collect-images --num-collected-imgs 100000 --num-processes 1

Train UNIT:

python -m unit.train --trainer UNIT --config unit/configs/roadfighter-lvl2.yaml

Run Road Fighter with UNIT:

python -m roadfighter_a2c.main --load --level 2 --test-gan --gan-dir roadfighter-lvl2-kl01 --num-processes 1

Run Road Fighter with UNIT and Imitation Learning:

python -m roadfighter_a2c.main_imitation --load --gan-dir roadfighter-lvl2-kl01 --gan-imitation-file '00320000' --log-name lvl2.log --super-during-rl --level 2 --det-score 5350

Acknowledgments

The code was written by Shani Gamrian and is based on the repositories: pytorch-a3c, pytorch-a2c, UNIT

TO-DO

Add links for pretrained models.
Create videos.

RL-GAN: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation

Related tags

Overview

RL-GAN: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation

Paper

Videos:

Installation

Getting Started

Breakout Examples

Road Fighter Examples

Acknowledgments

TO-DO

Owner

The official PyTorch implementation of recent paper - SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Training

Code for "Adversarial Training for a Hybrid Approach to Aspect-Based Sentiment Analysis

Reproducible research and reusable acyclic workflows in Python. Execute code on HPC systems as if you executed them on your personal computer!

ParmeSan: Sanitizer-guided Greybox Fuzzing

Neural style transfer in PyTorch.

Official PyTorch implementation of the preprint paper "Stylized Neural Painting", accepted to CVPR 2021.

PASSL包含 SimCLR，MoCo，BYOL，CLIP等基于对比学习的图像自监督算法以及 Vision-Transformer，Swin-Transformer，BEiT，CVT，T2T，MLP_Mixer等视觉Transformer算法

Repository for publicly available deep learning models developed in Rosetta community

FCAF3D: Fully Convolutional Anchor-Free 3D Object Detection

Lex Rosetta: Transfer of Predictive Models Across Languages, Jurisdictions, and Legal Domains

Deep Face Recognition in PyTorch

rliable is an open-source Python library for reliable evaluation, even with a handful of runs, on reinforcement learning and machine learnings benchmarks.

An implementation of the [Hierarchical (Sig-Wasserstein) GAN] algorithm for large dimensional Time Series Generation

Code for reproducible experiments presented in KSD Aggregated Goodness-of-fit Test.

This repository is the official implementation of the Hybrid Self-Attention NEAT algorithm.

Mix3D: Out-of-Context Data Augmentation for 3D Scenes (3DV 2021)

VR-Caps: A Virtual Environment for Active Capsule Endoscopy

A lossless neural compression framework built on top of JAX.

PyTorch code for the ICCV'21 paper: "Always Be Dreaming: A New Approach for Class-Incremental Learning"

This repository contains an implementation of ConvMixer for the ICLR 2022 submission "Patches Are All You Need?".