awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

Reinforcement learning library(framework) designed for PyTorch, implements DQN, DDPG, A2C, PPO, SAC, MADDPG, A3C, APEX, IMPALA ...

Semi-supervised Video Deraining with Dynamical Rain Generator (CVPR, 2021, Pytorch)

Pytorch implementation code for [Neural Architecture Search for Spiking Neural Networks]

Deep learning library featuring a higher-level API for TensorFlow.

PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models

🛰️ List of earth observation companies and job sites

Boosted neural network for tabular data

Block Sparse movement pruning

Learning Dense Representations of Phrases at Scale (Lee et al., 2020)

DeOldify - A Deep Learning based project for colorizing and restoring old images (and video!)

EM-POSE 3D Human Pose Estimation from Sparse Electromagnetic Trackers.

CSKG is a commonsense knowledge graph that combines seven popular sources into a consolidated representation

LiDAR R-CNN: An Efficient and Universal 3D Object Detector

A fast, dataset-agnostic, deep visual search engine for digital art history

A little software to generate and save Julia or Mandelbrot's Fractals.

Contrastive learning of Class-agnostic Activation Map for Weakly Supervised Object Localization and Semantic Segmentation (CVPR 2022)

render sprites into your desktop environment as shaped windows using GTK

Automated image registration. Registrationimation was too much of a mouthful.

공공장소에서 눈만 돌리면 CCTV가 보인다는 말이 과언이 아닐 정도로 CCTV가 우리 생활에 깊숙이 자리 잡았습니다.

📚 Papermill is a tool for parameterizing, executing, and analyzing Jupyter Notebooks.