Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Code for: https://berkeleyautomation.github.io/bags/

How to use TensorLayer

[Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021

This repository is an implementation of our NeurIPS 2021 paper (Stylized Dialogue Generation with Multi-Pass Dual Learning) in PyTorch.

Python script that analyses the given datasets and comes up with the best polynomial regression representation with the smallest polynomial degree possible

QT Py Media Knob using rotary encoder & neopixel ring

Image Matching Evaluation

Scripts and a shader to get you started on setting up an exported Koikatsu character in Blender.

Deep Reinforcement Learning for mobile robot navigation in ROS Gazebo simulator

A minimal implementation of face-detection models using flask, gunicorn, nginx, docker, and docker-compose

Noether Networks: meta-learning useful conserved quantities

The code for our NeurIPS 2021 paper "Kernelized Heterogeneous Risk Minimization".

Multi-Person Extreme Motion Prediction

Pcos-prediction - Predicts the likelihood of Polycystic Ovary Syndrome based on patient attributes and symptoms

Artificial intelligence technology inferring issues and logically supporting facts from raw text

4D Human Body Capture from Egocentric Video via 3D Scene Grounding

Generalized hybrid model for mode-locked laser diodes with an extended passive cavity

A PyTorch implementation of "Predict then Propagate: Graph Neural Networks meet Personalized PageRank" (ICLR 2019).

Code for the ECIR'22 paper "Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators"

SlotRefine: A Fast Non-Autoregressive Model forJoint Intent Detection and Slot Filling