Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Code for "Hierarchical Skills for Efficient Exploration" HSD-3 Algorithm and Baselines

This repository contains small projects related to Neural Networks and Deep Learning in general.

official Pytorch implementation of ICCV 2021 paper FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting.

Planner_backend - Academic planner application designed for students and counselors.

Flax is a neural network ecosystem for JAX that is designed for flexibility.

When BERT Plays the Lottery, All Tickets Are Winning

U-Net Implementation: Convolutional Networks for Biomedical Image Segmentation" using the Carvana Image Masking Dataset in PyTorch

Get a Grip! - A robotic system for remote clinical environments.

To Design and Implement Logistic Regression to Classify Between Benign and Malignant Cancer Types

POPPY (Physical Optics Propagation in Python) is a Python package that simulates physical optical propagation including diffraction

Graph Robustness Benchmark: A scalable, unified, modular, and reproducible benchmark for evaluating the adversarial robustness of Graph Machine Learning.

Implementation of Kaneko et al.'s MaskCycleGAN-VC model for non-parallel voice conversion.

[NeurIPS 2021] Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methods

CTF Challenge for CSAW Finals 2021

Tensors and neural networks in Haskell

Codes for our paper The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoders published to EMNLP 2021.

Dynamic Slimmable Network (CVPR 2021, Oral)

TransNet V2: Shot Boundary Detection Neural Network

A Sign Language detection project using Mediapipe landmark detection and Tensorflow LSTM's

Yolo algorithm for detection + centroid tracker to track vehicles