RL-GAN: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation

Last update: Nov 10, 2022

Related tags

Overview

RL-GAN: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation

RL-GAN is an official implementation of the paper: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation.

Paper

Shani Gamrian, Yoav Goldberg, "Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation"

@article{DBLP:journals/corr/abs-1806-07377,
  author    = {Shani Gamrian and
               Yoav Goldberg},
  title     = {Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image
               Translation},
  journal   = {CoRR},
  volume    = {abs/1806.07377},
  year      = {2018},
  url       = {http://arxiv.org/abs/1806.07377},
  archivePrefix = {arXiv},
  eprint    = {1806.07377},
  timestamp = {Mon, 13 Aug 2018 16:48:23 +0200},
  biburl    = {https://dblp.org/rec/bib/journals/corr/abs-1806-07377},
  bibsource = {dblp computer science bibliography, https://dblp.org}
}

Videos:

Breakout

RoadFighter

Installation

The code was tested on Ubuntu 16.04 with Python 3.6
Install packages by typing the command: pip install -r requirements.txt.
For Road Fighter, clone and install the repo: https://github.com/ShaniGam/retro

Getting Started

Breakout Examples

Train Breakout from scratch:

python -m breakout_a3c.main --num-processes 32 --variation 'standart'

Transfer from standart to diagonals variation and fine-tune the model:

python -m breakout_a3c.main --num-processes 32 --variation diagonals --ft-setting full-ft --test

Collect images for UNIT training:

python -m breakout_a3c.main --collect-images --num-collected-imgs 100000 --variation diagonals --num-processes 1

Train UNIT:

python -m unit.train --trainer UNIT --config unit/configs/breakout-diagonals.yaml

Run Breakout with UNIT:

python -m breakout_a3c.main --variation diagonals --test --ft-setting full-ft --test-gan --gan-dir breakout-diagonals --num-processes 0

Road Fighter Examples

Train level 1 of Road Fighter

python -m roadfighter_a2c.main --num-processes 84

Collect images for UNIT training:

python -m roadfighter_a2c.main -level 1 --collect-images --num-collected-imgs 100000 --num-processes 1
python -m roadfighter_a2c.main -level 2 --collect-images --num-collected-imgs 100000 --num-processes 1

Train UNIT:

python -m unit.train --trainer UNIT --config unit/configs/roadfighter-lvl2.yaml

Run Road Fighter with UNIT:

python -m roadfighter_a2c.main --load --level 2 --test-gan --gan-dir roadfighter-lvl2-kl01 --num-processes 1

Run Road Fighter with UNIT and Imitation Learning:

python -m roadfighter_a2c.main_imitation --load --gan-dir roadfighter-lvl2-kl01 --gan-imitation-file '00320000' --log-name lvl2.log --super-during-rl --level 2 --det-score 5350

Acknowledgments

The code was written by Shani Gamrian and is based on the repositories: pytorch-a3c, pytorch-a2c, UNIT

TO-DO

Add links for pretrained models.
Create videos.

RL-GAN: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation

Related tags

Overview

RL-GAN: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation

Paper

Videos:

Installation

Getting Started

Breakout Examples

Road Fighter Examples

Acknowledgments

TO-DO

Owner

Unofficial & improved implementation of NeRF--: Neural Radiance Fields Without Known Camera Parameters

the code for paper "Energy-Based Open-World Uncertainty Modeling for Confidence Calibration"

Implementation of the ICCV'21 paper Temporally-Coherent Surface Reconstruction via Metric-Consistent Atlases

Torch-mutable-modules - Use in-place and assignment operations on PyTorch module parameters with support for autograd

Source code of all the projects of Udacity Self-Driving Car Engineer Nanodegree.

Code and dataset for ACL2018 paper "Exploiting Document Knowledge for Aspect-level Sentiment Classification"

An end-to-end project on customer segmentation

img2pose: Face Alignment and Detection via 6DoF, Face Pose Estimation

Official PyTorch implementation of the paper "Recycling Discriminator: Towards Opinion-Unaware Image Quality Assessment Using Wasserstein GAN", accepted to ACM MM 2021 BNI Track.

MoCoGAN: Decomposing Motion and Content for Video Generation

Code for ACM MM2021 paper "Complementary Trilateral Decoder for Fast and Accurate Salient Object Detection"

MemStream: Memory-Based Anomaly Detection in Multi-Aspect Streams with Concept Drift

Various operations like path tracking, counting, etc by using yolov5

CL-Gym: Full-Featured PyTorch Library for Continual Learning

Source code of the paper "Deep Learning of Latent Variable Models for Industrial Process Monitoring".

Personal implementation of paper "Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval"

This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.

Improving Compound Activity Classification via Deep Transfer and Representation Learning

Official Pytorch Code for the paper TransWeather

Differentiable Surface Triangulation