PyTorch code accompanying the paper "Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning" (NeurIPS 2021).

Last update: Dec 14, 2022

Related tags

Deep Learning HIGL

Overview

HIGL

This is a PyTorch implementation for our paper: Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning (NeurIPS 2021).

Our code is based on official implementation of HRAC (NeurIPS 2020) and Map-planner (NeurIPS 2019)

Installation

conda create -n higl python=3.6
conda activate higl
./install_all.sh

Also, to run the MuJoCo experiments, a license is required (see here).

Usage

Training & Evaluation

Point Maze

./scripts/point_maze_sparse.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/point_maze_sparse.sh dense 5e5 0 2
./scripts/point_maze_sparse.sh sparse 5e5 0 2

Ant Maze (U-shape)

./scripts/higl_ant_maze_u.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u.sh dense 10e5 0 2
./scripts/higl_ant_maze_u.sh sparse 10e5 0 2

Ant Maze (W-shape)

./scripts/higl_ant_maze_w.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_w.sh dense 10e5 0 2
./scripts/higl_ant_maze_w.sh sparse 10e5 0 2

Reacher & Pusher

./scripts/higl_fetch.sh ${env} ${timesteps} ${gpu} ${seed}
./scripts/higl_fetch.sh Reacher3D-v0 5e5 0 2
./scripts/higl_fetch.sh Pusher-v0 10e5 0 2

Stochastic Ant Maze (U-shape)

./scripts/higl_ant_maze_u_stoch.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u_stoch.sh dense 10e5 0 2
./scripts/higl_ant_maze_u_stoch.sh sparse 10e5 0 2

PyTorch code accompanying the paper "Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning" (NeurIPS 2021).

Related tags

Overview

HIGL

Installation

Usage

Training & Evaluation

Owner

Junsu Kim

For encoding a text longer than 512 tokens, for example 800. Set max_pos to 800 during both preprocessing and training.

Efficient Two-Step Networks for Temporal Action Segmentation (Neurocomputing 2021)

An implementation of RetinaNet in PyTorch.

Source code for "Interactive All-Hex Meshing via Cuboid Decomposition [SIGGRAPH Asia 2021]".

A Distributional Approach To Controlled Text Generation

AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty

[ICCV 2021] Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identification

CasualHealthcare's Pneumonia detection with Artificial Intelligence (Convolutional Neural Network)

Make your AirPlay devices as TTS speakers

[ACM MM 2021] Joint Implicit Image Function for Guided Depth Super-Resolution

Christmas face app for Decathlon xmas coding party!

Cerberus Transformer: Joint Semantic, Affordance and Attribute Parsing

Open-World Entity Segmentation

A lane detection integrated Real-time Instance Segmentation based on YOLACT (You Only Look At CoefficienTs)

[NeurIPS 2021] The PyTorch implementation of paper "Self-Supervised Learning Disentangled Group Representation as Feature"

Python implementation of a live deep learning based age/gender/expression recognizer

Consumer Fairness in Recommender Systems: Contextualizing Definitions and Mitigations

Official implementation of particle-based models (GNS and DPI-Net) on the Physion dataset.

Paddle implementation for "Cross-Lingual Word Embedding Refinement by ℓ1 Norm Optimisation" (NAACL 2021)

Fast and accurate optimisation for registration with little learningconvexadam