Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

Ranking Models in Unlabeled New Environments （iccv21）

Code for HLA-Face: Joint High-Low Adaptation for Low Light Face Detection (CVPR21)

Labels4Free: Unsupervised Segmentation using StyleGAN

KUIELAB-MDX-Net got the 2nd place on the Leaderboard A and the 3rd place on the Leaderboard B in the MDX-Challenge ISMIR 2021

Robbing the FED: Directly Obtaining Private Data in Federated Learning with Modified Models

Hso-groupie - A pwnable challenge in Real World CTF 4th

Specificity-preserving RGB-D Saliency Detection

[Preprint] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang

Code for the paper "Balancing Training for Multilingual Neural Machine Translation, ACL 2020"

CR-Fill: Generative Image Inpainting with Auxiliary Contextual Reconstruction. ICCV 2021

MusicYOLO framework uses the object detection model, YOLOx, to locate notes in the spectrogram.

ByteTrack with ReID module following the paradigm of FairMOT, tracking strategy is borrowed from FairMOT/JDE.

PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.

Anagram Generator in Python

Official PyTorch implementation for paper Context Matters: Graph-based Self-supervised Representation Learning for Medical Images

Notes taking website build with Docker + Django + React.

Research Artifact of USENIX Security 2022 Paper: Automated Side Channel Analysis of Media Software with Manifold Learning

A bunch of random PyTorch models using PyTorch's C++ frontend

PyTorch implementation of the paper: Long-tail Learning via Logit Adjustment