PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Last update: Dec 28, 2022

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

This is the official PyTorch implementation of the ContrastiveCrop paper:

@article{peng2022crafting,
  title={Crafting Better Contrastive Views for Siamese Representation Learning},
  author={Peng, Xiangyu and Wang, Kai and Zhu, Zheng and You, Yang},
  journal={arXiv preprint arXiv:2202.03278},
  year={2022}
}

This repo includes PyTorch implementation of SimCLR, MoCo, BYOL and SimSiam, as well as their DDP training code.

Preparation

Create a python enviroment with pytorch >= 1.8.1.
pip install -r requirements.txt
Modify dataset root in the config file.

Pre-train

# MoCo, CIFAR-10
python DDP_moco_ccrop.py configs/small/cifar10/moco_alpha0.1_th0.1.py

# SimSiam, CIFAR-100
python DDP_simsiam_ccrop.py configs/small/cifar100/simsiam_alpha0.1_th0.1.py

Linear Evaluation

# CIFAR-10
python DDP_linear.py configs/linear/cifar10_res18.py --load ./checkpoints/small/cifar10/moco_alpha0.1_th0.1/last.pth

# CIFAR-100
python DDP_linear.py configs/linear/cifar100_res18.py --load ./checkpoints/small/cifar100/simsiam_alpha0.1_th0.1/last.pth

More models and datasets coming soon.

PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

Preparation

Pre-train

Linear Evaluation

Owner

PyTorch code for Composing Partial Differential Equations with Physics-Aware Neural Networks

The official codes for the ICCV2021 presentation "Uniformity in Heterogeneity: Diving Deep into Count Interval Partition for Crowd Counting"

Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition

[ICLR'21] Counterfactual Generative Networks

Implementations for the ICLR-2021 paper: SEED: Self-supervised Distillation For Visual Representation.

Scalable, event-driven, deep-learning-friendly backtesting library

Simple ray intersection library similar to coldet - succedeed by libacc

League of Legends Reinforcement Learning Environment (LoLRLE) multiple training scenarios using PPO.

Mmdet benchmark with python

Code & Experiments for "LILA: Language-Informed Latent Actions" to be presented at the Conference on Robot Learning (CoRL) 2021.

Model-free Vehicle Tracking and State Estimation in Point Cloud Sequences

Reviving Iterative Training with Mask Guidance for Interactive Segmentation

Official implementation of NLOS-OT: Passive Non-Line-of-Sight Imaging Using Optimal Transport (IEEE TIP, accepted)

Selfplay In MultiPlayer Environments

Official implementation of the paper Chunked Autoregressive GAN for Conditional Waveform Synthesis

An Implementation of Fully Convolutional Networks in Tensorflow.

GDSC-ML Team Interview Task

Background Matting: The World is Your Green Screen

Tensorflow implementation of our method: "Triangle Graph Interest Network for Click-through Rate Prediction".

Joint Discriminative and Generative Learning for Person Re-identification. CVPR'19 (Oral)