Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

The official re-implementation of the Neurips 2021 paper, "Targeted Neural Dynamical Modeling".

Pytorch implementation of MLP-Mixer with loading pre-trained models.

A curated list of awesome papers for Semantic Retrieval (TOIS Accepted: Semantic Models for the First-stage Retrieval: A Comprehensive Review).

Interpretable-contrastive-word-mover-s-embedding

[ECCV 2020] XingGAN for Person Image Generation

PyTorch implementation of the paper Deep Networks from the Principle of Rate Reduction

A solution to the 2D Ising model of ferromagnetism, implemented using the Metropolis algorithm

Code for the paper "Relation of the Relations: A New Formalization of the Relation Extraction Problem"

Face Library is an open source package for accurate and real-time face detection and recognition

Small little script to scrape, parse and check for active tor nodes. Can be used as proxies.

A small library for creating and manipulating custom JAX Pytree classes

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features

Code for the paper Task Agnostic Morphology Evolution.

Code for "Causal autoregressive flows" - AISTATS, 2021

Python tools for 3D face: 3DMM, Mesh processing(transform, camera, light, render), 3D face representations.

Official code release for "Learned Spatial Representations for Few-shot Talking-Head Synthesis" ICCV 2021

A script that trains a model to recognize handwritten digits using the MNIST data set.

Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensors, CVPR 2021

VQMIVC - Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversion

ML-PersonalWork - Big assignment PersonalWork in Machine Learning, 2021 autumn BUAA.