Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

ICRA 2021 "Towards Precise and Efficient Image Guided Depth Completion"

Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training

这是一个mobilenet-yolov4-lite的库，把yolov4主干网络修改成了mobilenet，修改了Panet的卷积组成，使参数量大幅度缩小。

Hierarchical Memory Matching Network for Video Object Segmentation (ICCV 2021)

🕹️ Official Implementation of Conditional Motion In-betweening (CMIB) 🏃

YOLOX-RMPOLY

A Gura parser implementation for Python

Final Project for the CS238: Decision Making Under Uncertainty course at Stanford University in Autumn '21.

Script that receives an Image (original) and a set of images to be used as "pixels" in reconstruction of the Original image using the set of images as "pixels"

A Simulated Optimal Intrusion Response Game

SemiNAS: Semi-Supervised Neural Architecture Search

Code for 2021 NeurIPS --- Towards Multi-Grained Explainability for Graph Neural Networks

TC-GNN with Pytorch integration

Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps[AAAI2021]

Official code for paper "Demystifying Local Vision Transformer: Sparse Connectivity, Weight Sharing, and Dynamic Weight"

[ICML 2020] "When Does Self-Supervision Help Graph Convolutional Networks?" by Yuning You, Tianlong Chen, Zhangyang Wang, Yang Shen

[CVPR 2021] Forecasting the panoptic segmentation of future video frames

Prompts - Read a textfile of prompts and import into anki via ankiconnect

Code for MSc Quantitative Finance Dissertation