awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

CVPR 2021 - Official code repository for the paper: On Self-Contact and Human Pose.

NCVX (NonConVeX): A User-Friendly and Scalable Package for Nonconvex Optimization in Machine Learning.

GLM (General Language Model)

LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detection

OoD Minimum Anomaly Score GAN - Code for the Paper 'OMASGAN: Out-of-Distribution Minimum Anomaly Score GAN for Sample Generation on the Boundary'

unet-family: Ultimate version

Multimodal commodity image retrieval 多模态商品图像检索

Tgbox-bench - Simple TGBOX upload speed benchmark

Official implementation for the paper "SAPE: Spatially-Adaptive Progressive Encoding for Neural Optimization".

A collection of papers about Transformer in the field of medical image analysis.

Multi-Glimpse Network With Python

An 16kHz implementation of HiFi-GAN for soft-vc.

Pixel-wise segmentation on VOC2012 dataset using pytorch.

for taichi voxel-challange event

Hypercomplex Neural Networks with PyTorch

The official PyTorch implementation of paper BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognition

A python-image-classification web application project, written in Python and served through the Flask Microframework

Pytorch implementation of "Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling"

naked is a Python tool which allows you to strip a model and only keep what matters for making predictions.

Scalable Graph Neural Networks for Heterogeneous Graphs