Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

[AAAI22] Reliable Propagation-Correction Modulation for Video Object Segmentation

code for our ECCV 2020 paper "A Balanced and Uncertainty-aware Approach for Partial Domain Adaptation"

Doubly Robust Off-Policy Evaluation for Ranking Policies under the Cascade Behavior Model

Collective Multi-type Entity Alignment Between Knowledge Graphs (WWW'20)

Code for "Retrieving Black-box Optimal Images from External Databases" (WSDM 2022)

RobustART: Benchmarking Robustness on Architecture Design and Training Techniques

Решения, подсказки, тесты и утилиты для тренировки по алгоритмам от Яндекса.

This repository is for our paper Exploiting Scene Graphs for Human-Object Interaction Detection accepted by ICCV 2021.

Playing around with FastAPI and streamlit to create a YoloV5 object detector

Meta graph convolutional neural network-assisted resilient swarm communications

KoRean based ELECTRA pre-trained models (KR-ELECTRA) for Tensorflow and PyTorch

DeepConsensus uses gap-aware sequence transformers to correct errors in Pacific Biosciences (PacBio) Circular Consensus Sequencing (CCS) data.

ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet

Lacmus is a cross-platform application that helps to find people who are lost in the forest using computer vision and neural networks.

PyTorch code accompanying our paper on Maximum Entropy Generators for Energy-Based Models

Trainable Bilateral Filter Layer (PyTorch)

IhoneyBakFileScan Modify - 批量网站备份文件扫描器，增加文件规则，优化内存占用

An Open-Source Toolkit for Prompt-Learning.

Self-labelling via simultaneous clustering and representation learning. (ICLR 2020)

Tutorials and implementations for "Self-normalizing networks"