HIGL
This is a PyTorch implementation for our paper: Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning (NeurIPS 2021).
Our code is based on official implementation of HRAC (NeurIPS 2020) and Map-planner (NeurIPS 2019)
Installation
conda create -n higl python=3.6
conda activate higl
./install_all.sh
Also, to run the MuJoCo experiments, a license is required (see here).
Usage
Training & Evaluation
- Point Maze
./scripts/point_maze_sparse.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/point_maze_sparse.sh dense 5e5 0 2
./scripts/point_maze_sparse.sh sparse 5e5 0 2
- Ant Maze (U-shape)
./scripts/higl_ant_maze_u.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u.sh dense 10e5 0 2
./scripts/higl_ant_maze_u.sh sparse 10e5 0 2
- Ant Maze (W-shape)
./scripts/higl_ant_maze_w.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_w.sh dense 10e5 0 2
./scripts/higl_ant_maze_w.sh sparse 10e5 0 2
- Reacher & Pusher
./scripts/higl_fetch.sh ${env} ${timesteps} ${gpu} ${seed}
./scripts/higl_fetch.sh Reacher3D-v0 5e5 0 2
./scripts/higl_fetch.sh Pusher-v0 10e5 0 2
- Stochastic Ant Maze (U-shape)
./scripts/higl_ant_maze_u_stoch.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u_stoch.sh dense 10e5 0 2
./scripts/higl_ant_maze_u_stoch.sh sparse 10e5 0 2
14 Dec 09, 2022
24 Dec 12, 2022
204 Dec 15, 2022
2.8k Jan 07, 2023
144 Jan 03, 2023
7 Apr 23, 2022
481 Dec 29, 2022
1.3k Jan 01, 2023
53 May 18, 2022
1.1k Dec 27, 2022
18 Dec 08, 2022
270 Dec 30, 2022
26 Oct 18, 2022
60 Jan 03, 2023
1 Jun 02, 2022
405 Jan 05, 2023
657 Jan 09, 2023
19 Dec 26, 2022
18 Nov 06, 2022
118 Dec 25, 2022