HIGL
This is a PyTorch implementation for our paper: Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning (NeurIPS 2021).
Our code is based on official implementation of HRAC (NeurIPS 2020) and Map-planner (NeurIPS 2019)
Installation
conda create -n higl python=3.6
conda activate higl
./install_all.sh
Also, to run the MuJoCo experiments, a license is required (see here).
Usage
Training & Evaluation
- Point Maze
./scripts/point_maze_sparse.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/point_maze_sparse.sh dense 5e5 0 2
./scripts/point_maze_sparse.sh sparse 5e5 0 2
- Ant Maze (U-shape)
./scripts/higl_ant_maze_u.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u.sh dense 10e5 0 2
./scripts/higl_ant_maze_u.sh sparse 10e5 0 2
- Ant Maze (W-shape)
./scripts/higl_ant_maze_w.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_w.sh dense 10e5 0 2
./scripts/higl_ant_maze_w.sh sparse 10e5 0 2
- Reacher & Pusher
./scripts/higl_fetch.sh ${env} ${timesteps} ${gpu} ${seed}
./scripts/higl_fetch.sh Reacher3D-v0 5e5 0 2
./scripts/higl_fetch.sh Pusher-v0 10e5 0 2
- Stochastic Ant Maze (U-shape)
./scripts/higl_ant_maze_u_stoch.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u_stoch.sh dense 10e5 0 2
./scripts/higl_ant_maze_u_stoch.sh sparse 10e5 0 2
114 Nov 27, 2022
9 Oct 13, 2022
17 Sep 27, 2022
6 Nov 29, 2022
8 May 22, 2022
401 Nov 19, 2022
110 Dec 27, 2022
55 Dec 24, 2022
37 Sep 15, 2022
15 Apr 16, 2022
16 Nov 26, 2022
38 Oct 18, 2022
1.3k Dec 29, 2022
169 Dec 02, 2022
111 Dec 31, 2022
93 Jan 05, 2023
16 Dec 07, 2022
883 Jan 07, 2023
1 Jan 12, 2022
149 Jan 04, 2023