awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

Learning Versatile Neural Architectures by Propagating Network Codes

PyG (PyTorch Geometric) - A library built upon PyTorch to easily write and train Graph Neural Networks (GNNs)

Predictive AI layer for existing databases.

An official source code for "Augmentation-Free Self-Supervised Learning on Graphs"

Repository for training material for the 2022 SDSC HPC/CI User Training Course

Implementation of accepted AAAI 2021 paper: Deep Unsupervised Image Hashing by Maximizing Bit Entropy

The code for 'Deep Residual Fourier Transformation for Single Image Deblurring'

Simple and Robust Loss Design for Multi-Label Learning with Missing Labels

Self-supervised Label Augmentation via Input Transformations (ICML 2020)

Predicting Tweet Sentiment Maching Learning and streamlit

ML powered analytics engine for outlier detection and root cause analysis.

Pytorch implementation for DFN: Distributed Feedback Network for Single-Image Deraining.

A simple Python library for stochastic graphical ecological models

classify fashion-mnist dataset with pytorch

An easy-to-use app to visualise attentions of various VQA models.

PyGCL: A PyTorch Library for Graph Contrastive Learning

Code for the head detector (HeadHunter) proposed in our CVPR 2021 paper Tracking Pedestrian Heads in Dense Crowd.

PyTorch IPFS Dataset

Proposed n-stage Latent Dirichlet Allocation method - A Novel Approach for LDA

Dataset and Code for ICCV 2021 paper "Real-world Video Super-resolution: A Benchmark Dataset and A Decomposition based Learning Scheme"