Self-Supervised Learning

Last update: Dec 14, 2021

Overview

Self-Supervised Learning

Features

self_supervised offers features like

modular framework
support for multi-gpu training using PyTorch Lightning
easy to use and written in a PyTorch like style
supports custom backbone models for self-supervised pre-training

Supported Models

Supported Loss Function

Benchmarks

Currently implemented models and their accuracy on cifar10 and imagenette.

ImageNette

Model	Epochs	Batch Size	Test Accuracy
MoCo	800	256	0.827
SimCLR	800	256	0.847
SimSiam	800	256	0.827
BarlowTwins	800	256	0.801
BYOL	800	256	0.851

Cifar10

Model	Epochs	Batch Size	Test Accuracy
MoCo	200	128	0.83
SimCLR	200	128	0.78
SimSiam	200	128	0.73
BarlowTwins	200	128	0.84
BYOL	200	128	0.85
MoCo	200	512	0.85
SimCLR	200	512	0.83
SimSiam	200	512	0.81
BarlowTwins	200	512	0.78
BYOL	200	512	0.84
MoCo	800	128	0.89
SimCLR	800	128	0.87
SimSiam	800	128	0.80
MoCo	800	512	0.90
SimCLR	800	512	0.89
SimSiam	800	512	0.91

Tutorials

Want to jump to the tutorials and see lightly in action?

Self-Supervised Learning

Related tags

Overview

Self-Supervised Learning

Features

Supported Models

Supported Loss Function

Benchmarks

ImageNette

Cifar10

Tutorials

Further Reading

Owner

Robin

Action Segmentation Evaluation

A PyTorch re-implementation of the paper 'Exploring Simple Siamese Representation Learning'. Reproduced the 67.8% Top1 Acc on ImageNet.

The official implementation of Equalization Loss for Long-Tailed Object Recognition (CVPR 2020) based on Detectron2

PClean: A Domain-Specific Probabilistic Programming Language for Bayesian Data Cleaning

The Simplest DCGAN Implementation

NeuralDiff: Segmenting 3D objects that move in egocentric videos

Aalto-cs-msc-theses - Listing of M.Sc. Theses of the Department of Computer Science at Aalto University

Set of models for classifcation of 3D volumes

Collections for the lasted paper about multi-view clustering methods (papers, codes)

Code for models used in Bashiri et al., "A Flow-based latent state generative model of neural population responses to natural images".

Evolving neural network parameters in JAX.

Understanding the Effects of Datasets Characteristics on Offline Reinforcement Learning

LSUN Dataset Documentation and Demo Code

PyTorch implementation of CloudWalk's recent work DenseBody

Code for training and evaluation of the model from "Language Generation with Recurrent Generative Adversarial Networks without Pre-training"

Collect super-resolution related papers, data, repositories

SuperSDR: multiplatform KiwiSDR + CAT transceiver integrator

Context Decoupling Augmentation for Weakly Supervised Semantic Segmentation

This repo is developed for Strong Baseline For Vehicle Re-Identification in Track 2 Ai-City-2021 Challenges

Json2Xml tool will help you convert from json COCO format to VOC xml format in Object Detection Problem.