PyTorch code accompanying the paper "Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning" (NeurIPS 2021).

Last update: Dec 14, 2022

Related tags

Deep Learning HIGL

Overview

HIGL

This is a PyTorch implementation for our paper: Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning (NeurIPS 2021).

Our code is based on official implementation of HRAC (NeurIPS 2020) and Map-planner (NeurIPS 2019)

Installation

conda create -n higl python=3.6
conda activate higl
./install_all.sh

Also, to run the MuJoCo experiments, a license is required (see here).

Usage

Training & Evaluation

Point Maze

./scripts/point_maze_sparse.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/point_maze_sparse.sh dense 5e5 0 2
./scripts/point_maze_sparse.sh sparse 5e5 0 2

Ant Maze (U-shape)

./scripts/higl_ant_maze_u.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u.sh dense 10e5 0 2
./scripts/higl_ant_maze_u.sh sparse 10e5 0 2

Ant Maze (W-shape)

./scripts/higl_ant_maze_w.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_w.sh dense 10e5 0 2
./scripts/higl_ant_maze_w.sh sparse 10e5 0 2

Reacher & Pusher

./scripts/higl_fetch.sh ${env} ${timesteps} ${gpu} ${seed}
./scripts/higl_fetch.sh Reacher3D-v0 5e5 0 2
./scripts/higl_fetch.sh Pusher-v0 10e5 0 2

Stochastic Ant Maze (U-shape)

./scripts/higl_ant_maze_u_stoch.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u_stoch.sh dense 10e5 0 2
./scripts/higl_ant_maze_u_stoch.sh sparse 10e5 0 2

PyTorch code accompanying the paper "Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning" (NeurIPS 2021).

Related tags

Overview

HIGL

Installation

Usage

Training & Evaluation

Owner

Junsu Kim

scAR (single-cell Ambient Remover) is a package for data denoising in single-cell omics.

Tools for the Cleveland State Human Motion and Control Lab

A Python library for Deep Probabilistic Modeling

Official PyTorch implementation of the paper: DeepSIM: Image Shape Manipulation from a Single Augmented Training Sample

A PyTorch implementation of DenseNet.

LSTM-VAE Implementation and Relevant Evaluations

The implementation for paper Joint t-SNE for Comparable Projections of Multiple High-Dimensional Datasets.

This repository contains several jupyter notebooks to help users learn to use neon, our deep learning framework

Ludwig is a toolbox that allows to train and evaluate deep learning models without the need to write code.

The Self-Supervised Learner can be used to train a classifier with fewer labeled examples needed using self-supervised learning.

FS-Mol: A Few-Shot Learning Dataset of Molecules

Generic template to bootstrap your PyTorch project with PyTorch Lightning, Hydra, W&B, and DVC.

Posterior temperature optimized Bayesian models for inverse problems in medical imaging

Implementation of the paper ''Implicit Feature Refinement for Instance Segmentation''.

ALBERT-pytorch-implementation - ALBERT pytorch implementation

VL-LTR: Learning Class-wise Visual-Linguistic Representation for Long-Tailed Visual Recognition

Tgbox-bench - Simple TGBOX upload speed benchmark

Ivy is a templated deep learning framework which maximizes the portability of deep learning codebases.

Local Similarity Pattern and Cost Self-Reassembling for Deep Stereo Matching Networks

Final Project for the CS238: Decision Making Under Uncertainty course at Stanford University in Autumn '21.