awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

PyContinual (An Easy and Extendible Framework for Continual Learning)

Data reduction pipeline for KOALA on the AAT.

DexterRedTool - Dexter's Red Team Tool that creates cronjob/task scheduler to consistently creates users

GAN-generated image detection based on CNNs

YOLOX-Paddle - A reproduction of YOLOX by PaddlePaddle

CLDF dataset derived from Robbeets et al.'s "Triangulation Supports Agricultural Spread" from 2021

Blender Add-On for slicing meshes with planes

This repository contains the implementation of the paper Contrastive Instance Association for 4D Panoptic Segmentation using Sequences of 3D LiDAR Scans

Implementation of ResMLP, an all MLP solution to image classification, in Pytorch

Example how to deploy deep learning model with aiohttp.

Semantic Image Synthesis with SPADE

NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsampling

Manage the availability of workspaces within Frappe/ ERPNext (sidebar) based on user-roles

Imaging, analysis, and simulation software for radio interferometry

Official implementation of "CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding" (CVPR, 2022)

Adversarial Learning for Semi-supervised Semantic Segmentation, BMVC 2018

AI-Fitness-Tracker - AI Fitness Tracker With Python

Malware Bypass Research using Reinforcement Learning

Kaggle G2Net Gravitational Wave Detection : 2nd place solution

Additional environments compatible with OpenAI gym