The Great Autoencoder Bake Off

Last update: Jan 06, 2023

Related tags

Miscellaneous ae_bakeoff

Overview

The Great Autoencoder Bake Off

The companion repository to a post on my blog. It contains all you need to reproduce the results.

Features

Currently featured autoencoders:

Shallow AE
Deep (vanilla) AE
Stacked AE
Sparse AE
Denoising AE
VAE
beta-VAE
vq-VAE

They are evaluated on MNIST for the following tasks:

Reconstruction quality
Quality of decoded samples from the latent space (if possible)
Quality of latent space interpolation
Structure of the latent space visualized with UMAP
ROC curve for anomaly detection with the reconstruction error
Classification accuracy of a linear layer fitted on the autoencoder's features

Installation

Clone the repository and create a new conda environment with:

conda create -n ae_bakeoff python=3.7
conda activate ae_bakeoff
conda install --file requirements.txt -c pytorch -c conda-forge

Verify the installation by running the tests:

cd ./tests
export PYTHONPATH="../src"
python -m unittest

Usage

To one-click reproduce all results, call:

cd ./src
python reproduce.py --batch_size 256 [--gpu]

If you want to run any specific experiment, call:

python run.py <autoencoder_type> --batch_size 256 [--gpu] [--anomaly]

This project uses reinforcement learning on stock market and agent tries to learn trading. The goal is to check if the agent can learn to read tape. The project is dedicated to hero in life great Jesse Livermore.

Reinforcement-trading This project uses Reinforcement learning on stock market and agent tries to learn trading. The goal is to check if the agent can

1.4k Dec 22, 2022

RepVGG: Making VGG-style ConvNets Great Again

This repository is the code that needs to be submitted for OpenMMLab Algorithm Ecological Challenge，the paper is RepVGG: Making VGG-style ConvNets Great Again

62 May 21, 2022

A discord Server Bot made with Python, This bot helps people feel better by inspiring them with motivational quotes or by responding with a great message, also the users of the server can create custom messages by telling the bot with Commands.

A discord Server Bot made with Python, This bot helps people feel better by inspiring them with motivational quotes or by responding with a great message, also the users of the server can create custom messages by telling the bot with Commands.

1 Oct 13, 2021

A sentence search engine that fetches examples from trusted news/media organisations. Great for writing better English.

A sentence search engine that fetches examples from trusted news/media websites. Great for improving writing & speaking better English.

1 Apr 4, 2022

The Simpsons and Machine Learning: What makes an Episode Great?

The Simpsons and Machine Learning: What makes an Episode Great? Check out my Medium article on this! PROBLEM: The Simpsons has had a decline in qualit

1 Nov 2, 2021

Info for The Great DataTas plot-a-thon

The Great DataTas plot-a-thon Datatas is organising a Data Visualisation competition: The Great DataTas plot-a-thon We will be using Tidy Tuesday data

2 Nov 21, 2021

neo Tool is great one in binary exploitation topic

neo Tool is great one in binary exploitation topic. instead of doing several missions by many tools and windows, you can now automate this in one tool in one session.. Enjoy it

4 Oct 10, 2022

Blender addon that enables exporting of xmodels from blender. Great for custom asset creation for cod games

Birdman's XModel Tools For Blender Greetings everyone in the custom cod community. This blender addon should finally enable exporting of custom assets

2 Jul 2, 2022

A great and handy python obfuscator for protecting code.

Python Code Obfuscator A handy and necessary tool that can protect your code anytime! Mostly Command Line tool that will obfuscate your code. Features

5 Nov 18, 2022

Athens: a great tool for taking notes and organising knowldge

AthensSyncer Athens is a great tool for taking notes and organising knowldge. But it is a bummer that you cannot use it accross multiple devices. Well

6 Dec 14, 2022

Get input from OLED Joystick, Runs command, Displays output on OLED Screen (Great for P4wnP1)

p4wnsolo-joyterm Gets text input from OLED Joystick Runs the command you typed Displays output on OLED Screen (Great for P4wnP1 - even better on Raspb

7 Dec 19, 2022

A great python/java dynamic DNS service for NameSilo, with log, email reminder...

English NameSilo DDNS is a DDNS service for NameSilo domain names for home broadband , it can automatically detect IP changes in home broadband

77 Dec 28, 2022

Automatically pulls specified repository whenever a specified file is pushed. Great for working collaboratively when you need to run something locally.

autopull Simple python tool that allows you to automatically pull from a github repository whenever a file with a specified name is uploaded installat

0 Sep 27, 2022

Comments

In re: your Reddit post
You posted on Reddit.

I think this is very cool.

In the Reddit post you ask if you missed any AE types, but in the blog post you encourage people to add PRs to add AE types. I'm too new to do the latter, so I'm just going to mention the names I know.

Your existing types:

Shallow AE

Deep (vanilla) AE

Stacked AE

Sparse AE

Denoising AE

VAE

beta-VAE

vq-VAE

I'm curious to see if vqVAE2 does better than 1 in here.

This list doesn't have

TD-VAE,

Contractive AE,

Undercomplete AE,

Convolutional AE,

Pixel VAE,

Conditional VAE,

DFC VAE,

Derivative Penalized VAE,

Stacked Similarity-Aware AE,

Replacement AE,

AE2-Net,

VAE-SNE,

Correspondence AE,

Adversarial Conditional AE,

Prior Flow VAE,

Factorized Gaussian Process VAE,

Scalable Gaussian Process VAE,

Sparse Gaussian Process VAE,

VAE-LSTM,

LSTM-based VAE (actually very different,)

SNF-CVAE,

MAD-VAE,

Disentangled Causal Effect VAE,

Coupled VAE,

Triplet Enhanced Autoencoder,

Hypergraph VAE,

Exemplar VAE,

Autoencoding VAE (amusingly it's a good name,)

Geometry-aware Hamiltonian VAE,

Quaternion-valued VAE,

Heirarchal Latent Embedding VQ-VAE,

Dirichlet Graph VAE,

Discriminative Mixture VAE,

Complex-valued VAE,

Variational Recurrent AE,

NCP-VAE,

Targeted VAE,

Heirarchical Sparse VAE,

Discrete Memory Addressing VAE,

Multi-adversarial VAE,

VAE-BRIDGE,

Cycle VAE,

Dynamic VAE,

DCAVN,

Ordinal Content VAE,

Quasi-symplectic Langevin VAE,

Stochastic Recurrent Networks,

Deep Kalman Filters,

Kalman VAEs,

Stochastic Recurrent NNs,

Disentangled Sequential AEs,

Neural Adaptive Sequential Monte Carlo

and arguably

Variational Converter-Encoder

plus things that don't apply, except maybe they do because gpt-3 makes images, like

Plan CVAE,

Condition-Transforming VAE,

Disentangled Causal Representation Learning
opened by StoneCypher 3

Releases(v1.2)

v1.2(Mar 23, 2021)

I am a dummy and forgot a power of two in the calculation of the anomaly score. This resulted in invalid scores. I now use BCE as a score to be consistent with training.

Blog update will follow.
Source code(tar.gz)
Source code(zip)
v1.1(Mar 3, 2021)

This release adds the MNIST alternatives Fashion-MNIST (FMNIST) and Kuzushiji-MNIST (KMNIST) as additional datasets. They are usable via the new CLI argument --dataset. The logs directory now has a sub-directory for each dataset.

The training time of each autoencoder is now recorded and rendered as a markdown table.

All changes are reflected in the results.
Source code(tar.gz)
Source code(zip)
v1.0(Jan 28, 2021)

Source code(tar.gz)
Source code(zip)

The Great Autoencoder Bake Off

Related tags

Overview

The Great Autoencoder Bake Off

Features

Installation

Usage

You might also like...

This project uses reinforcement learning on stock market and agent tries to learn trading. The goal is to check if the agent can learn to read tape. The project is dedicated to hero in life great Jesse Livermore.

RepVGG: Making VGG-style ConvNets Great Again

A discord Server Bot made with Python, This bot helps people feel better by inspiring them with motivational quotes or by responding with a great message, also the users of the server can create custom messages by telling the bot with Commands.

A sentence search engine that fetches examples from trusted news/media organisations. Great for writing better English.

The Simpsons and Machine Learning: What makes an Episode Great?

Info for The Great DataTas plot-a-thon

neo Tool is great one in binary exploitation topic

Blender addon that enables exporting of xmodels from blender. Great for custom asset creation for cod games

A great and handy python obfuscator for protecting code.

Athens: a great tool for taking notes and organising knowldge

Get input from OLED Joystick, Runs command, Displays output on OLED Screen (Great for P4wnP1)

A great python/java dynamic DNS service for NameSilo, with log, email reminder...

Automatically pulls specified repository whenever a specified file is pushed. Great for working collaboratively when you need to run something locally.

This Open-Source project is great for sensor capture and storage solutions.

StrongSORT: Make DeepSORT Great Again

Speech Enhancement Generative Adversarial Network Based on Asymmetric AutoEncoder

Official Implementation of Swapping Autoencoder for Deep Image Manipulation (NeurIPS 2020)

An unofficial implementation of the paper "AutoVC: Zero-Shot Voice Style Transfer with Only Autoencoder Loss".

Clockwork Variational Autoencoder

Comments

In re: your Reddit post

Releases(v1.2)

v1.2(Mar 23, 2021)

v1.1(Mar 3, 2021)

v1.0(Jan 28, 2021)

Owner

Tilman Krokotsch

Python client SDK designed to simplify integrations by automating key generation and certificate enrollment using Venafi machine identity services.

Semester long, web application project for CSCI 4370/6370 (Database Management)

Ferramenta de monitoramento do risco de colapso no sistema de saúde em municípios brasileiros com a Covid-19.

RDFLib is a Python library for working with RDF, a simple yet powerful language for representing information.

One-stop-shop for docs and test coverage of dbt projects.

Whole-day timezone comparison

SuperCollider library for Python

Automation in socks label validation

Comics/doujinshi reader application. Web-based, will work on desktop and tablet devices with swipe interface.

OntoSeer is a tool to help users build better quality ontologies

A Python script to delete movies with a certain tag after a certain amount of days.

Addon for Blender 2.8+ that automatically creates NLA tracks for all animations. Useful for GLTF export.

Python script that automates the tasks involved in starting a new coding project

NASH 2021 project... this may or may not end up working 🤷‍♂️

A Bot that adds YouTube views to your video of choice

Create beautiful diagrams just by typing mathematical notation in plain text.

CD for MachineLearnia

Fastest Semantle solver this side of the Mississippi

The Google Assistant on a rotary phone

A simple program to run through inputs for a 3n+1 problem