Differentiable Annealed Importance Sampling (DAIS)

This repository contains the code to reproduce the DAIS results from the paper Differentiable Annealed Importance Sampling and the Perils of Gradient Noise.

Bayesian Linear Regression

Please first install JAX (https://github.com/google/jax), then reproduce our results by running the following:

python blr/dais.py --gamma 0.0
python blr/dais.py --gamma 0.9
python blr.dais.py --bsize 100

Variational Autoencoder

Please first install PyTorch (https://pytorch.org/).

For training, one example command for DAIS with $K = 10$ and $S = 5$ (to adapt annealing scheme, add --adapt_beta):

python vae/mnist_train.py --lf_step 10 --n_particles 5 --lf_lrate 0.08

After training, you can find the saved checkpoint and evaluate it (e.g., using AIS):

python vae/mnist_eval.py --ais --n_particles 10 --lf_step 10000 --lf_lrate 0.05 --resume xxx

Also, you can reproduce the evaulation results of AIS/HAIS/DAIS by runing vae/mnist_eval_scaling.py:

python vae/mnist_eval_scaling.py --linear_beta --lf_lrate 0.08 --n_particles 10 --resume xxx

Citation

To cite this work, please use

@inproceedings{
	zhang2021differentiable,
	title={Differentiable Annealed Importance Sampling and the Perils of Gradient Noise},
	author={Guodong Zhang and Kyle Hsu and Jianing Li and Chelsea Finn and Roger Baker Grosse},
	booktitle={Thirty-Fifth Conference on Neural Information Processing Systems},
	year={2021},
	url={https://openreview.net/forum?id=6rqjgrL7Lq}
}

Differentiable Annealed Importance Sampling (DAIS)

Related tags

Overview

Differentiable Annealed Importance Sampling (DAIS)

Bayesian Linear Regression

Variational Autoencoder

Citation

Owner

Guodong Zhang

GAN-generated image detection based on CNNs

YOLOX-CondInst - Implement CondInst which is a instances segmentation method on YOLOX

Object-Centric Learning with Slot Attention

Negative Sample Matters: A Renaissance of Metric Learning for Temporal Grounding

Fast Neural Representations for Direct Volume Rendering

This repository gives an example on how to preprocess the data of the HECKTOR challenge

PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+

Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding

Single cell current best practices tutorial case study for the paper:Luecken and Theis, "Current best practices in single-cell RNA-seq analysis: a tutorial"

This repository is the code of the paper Accelerating Deep Reinforcement Learning for Digital Twin Network Optimization with Evolutionary Strategies

All course materials for the Zero to Mastery Machine Learning and Data Science course.

Supporting code for the Neograd algorithm

Rl-quickstart - Reinforcement Learning Quickstart

A module for solving and visualizing Schrödinger equation.

A curated list of neural rendering resources.

Deep learning toolbox based on PyTorch for hyperspectral data classification.

QKeras: a quantization deep learning library for Tensorflow Keras

Sematic-Segmantation - Semantic Segmentation on MIT ADE20K dataset in PyTorch

Unofficial PyTorch reimplementation of the paper Swin Transformer V2: Scaling Up Capacity and Resolution

PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Clouds