HIGL
This is a PyTorch implementation for our paper: Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning (NeurIPS 2021).
Our code is based on official implementation of HRAC (NeurIPS 2020) and Map-planner (NeurIPS 2019)
Installation
conda create -n higl python=3.6
conda activate higl
./install_all.sh
Also, to run the MuJoCo experiments, a license is required (see here).
Usage
Training & Evaluation
- Point Maze
./scripts/point_maze_sparse.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/point_maze_sparse.sh dense 5e5 0 2
./scripts/point_maze_sparse.sh sparse 5e5 0 2
- Ant Maze (U-shape)
./scripts/higl_ant_maze_u.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u.sh dense 10e5 0 2
./scripts/higl_ant_maze_u.sh sparse 10e5 0 2
- Ant Maze (W-shape)
./scripts/higl_ant_maze_w.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_w.sh dense 10e5 0 2
./scripts/higl_ant_maze_w.sh sparse 10e5 0 2
- Reacher & Pusher
./scripts/higl_fetch.sh ${env} ${timesteps} ${gpu} ${seed}
./scripts/higl_fetch.sh Reacher3D-v0 5e5 0 2
./scripts/higl_fetch.sh Pusher-v0 10e5 0 2
- Stochastic Ant Maze (U-shape)
./scripts/higl_ant_maze_u_stoch.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u_stoch.sh dense 10e5 0 2
./scripts/higl_ant_maze_u_stoch.sh sparse 10e5 0 2
1 Oct 28, 2022
15 Jun 11, 2022
1 Mar 16, 2022
1.7k Dec 31, 2022
362 Jan 03, 2023
6 May 26, 2022
5 Aug 31, 2022
49 Dec 10, 2022
0 Jan 20, 2022
1k Jan 03, 2023
61 Dec 02, 2022
122 Dec 07, 2022
229 Dec 13, 2022
22 Oct 21, 2022
64 Nov 20, 2022
3 Nov 15, 2022
66 Oct 07, 2022
5 Jan 28, 2022
19 Sep 29, 2022
1 Jan 14, 2022