Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Pytorch implementation of FlowNet by Dosovitskiy et al.

A fast implementation of bss_eval metrics for blind source separation

A bunch of random PyTorch models using PyTorch's C++ frontend

GUI for a Vocal Remover that uses Deep Neural Networks.

Official Implementation for the "An Empirical Investigation of 3D Anomaly Detection and Segmentation" paper.

Next-Best-View Estimation based on Deep Reinforcement Learning for Active Object Classification

Artificial Intelligence playing minesweeper 🤖

OMNIVORE is a single vision model for many different visual modalities

[ICLR 2021] "Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective" by Wuyang Chen, Xinyu Gong, Zhangyang Wang

Image super-resolution (SR) is a fast-moving field with novel architectures attracting the spotlight

🎁 3,000,000+ Unsplash images made available for research and machine learning

A small library for creating and manipulating custom JAX Pytree classes

Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"

Efficient electromagnetic solver based on rigorous coupled-wave analysis for 3D and 2D multi-layered structures with in-plane periodicity

Rax is a Learning-to-Rank library written in JAX

Code for "Retrieving Black-box Optimal Images from External Databases" (WSDM 2022)

A multilingual version of MS MARCO passage ranking dataset

This repository contains the source code for the paper Tutorial on amortized optimization for learning to optimize over continuous domains by Brandon Amos

Implementing yolov4 target detection and tracking based on nao robot