Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Exponential Graph is Provably Efficient for Decentralized Deep Training

Eye-Blink-Counter - Python based Computer Vision project which counts how many time a person blinks

Python implementation of "Elliptic Fourier Features of a Closed Contour"

Minecraft agent to farm resources using reinforcement learning

A PyTorch-Based Framework for Deep Learning in Computer Vision

The description of FMFCC-A (audio track of FMFCC) dataset and Challenge resluts.

Animal Sound Classification (Cats Vrs Dogs Audio Sentiment Classification)

A high-level Python library for Quantum Natural Language Processing

[CVPR2021 Oral] UP-DETR: Unsupervised Pre-training for Object Detection with Transformers

This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".

PyTorch implementation of SwAV (Swapping Assignments between Views)

NALSM: Neuron-Astrocyte Liquid State Machine

Benchmark for the generalization of 3D machine learning models across different remeshing/samplings of a surface.

League of Legends Reinforcement Learning Environment (LoLRLE) multiple training scenarios using PPO.

Rank 1st in the public leaderboard of ScanRefer (2021-03-18)

ROMP: Monocular, One-stage, Regression of Multiple 3D People, ICCV21

Open-source python package for the extraction of Radiomics features from 2D and 3D images and binary masks.

A python implementation of Deep-Image-Analogy based on pytorch.

AI virtual gym is an AI program which can be used to exercise and can be used to see if we are doing the exercises

Source code related to the article submitted to the International Conference on Computational Science ICCS 2022 in London