Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Last update: Nov 25, 2022

Related tags

Deep Learning CMSF

Overview

CMSF

Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Requirements

Python >= 3.7.6
PyTorch >= 1.4
torchvision >= 0.5.0
faiss-gpu >= 1.6.1

Install PyTorch and ImageNet dataset following the official PyTorch ImageNet training code. We used Python 3.7 for our experiments.

Install PyTorch (pytorch.org)

To run NN and CMSF-KM, you require to install FAISS.

FAISS:

Install FAISS (https://github.com/facebookresearch/faiss/blob/master/INSTALL.md)

Training Self-Supservised CMSF-KM

python self_supervised/train_msf_km.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 5 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --num_clusters 50000 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

Training Self-Supservised CMSF-2Q

python self_supervised/train_msf_2q.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 5 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --topkp 5 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

Training Supservised

Following command can be used to train the CMSF(Supervised Learning)

python supervised/train_sup_msf.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 10 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

License

This project is under the MIT license.

Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Related tags

Overview

CMSF

Requirements

Training Self-Supservised CMSF-KM

Training Self-Supservised CMSF-2Q

Training Supservised

License

Owner

Source code for EquiDock: Independent SE(3)-Equivariant Models for End-to-End Rigid Protein Docking (ICLR 2022)

Face Detection & Age Gender & Expression & Recognition

This repository contains the code used for the implementation of the paper "Probabilistic Regression with HuberDistributions"

PyTorch implementaton of our CVPR 2021 paper "Bridging the Visual Gap: Wide-Range Image Blending"

Hypercomplex Neural Networks with PyTorch

Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation principle for unnormalized statistical models." (Gutmann and Hyvarinen, AISTATS 2010)

AdamW optimizer and cosine learning rate annealing with restarts

Script that attempts to force M1 macs into RGB mode when used with monitors that are defaulting to YPbPr.

BasicRL: easy and fundamental codes for deep reinforcement learning。It is an improvement on rainbow-is-all-you-need and OpenAI Spinning Up.

Using PyTorch Perform intent classification using three different models to see which one is better for this task

Official implementation of the method ContIG, for self-supervised learning from medical imaging with genomics

Symbolic Parallel Adaptive Importance Sampling for Probabilistic Program Analysis in JAX

Code for IntraQ, PyTorch implementation of our paper under review

A self-supervised learning framework for audio-visual speech

NeuralWOZ: Learning to Collect Task-Oriented Dialogue via Model-based Simulation (ACL-IJCNLP 2021)

From Canonical Correlation Analysis to Self-supervised Graph Neural Networks

Lightweight tool to perform MITM attack on local network

FACIAL: Synthesizing Dynamic Talking Face With Implicit Attribute Learning. ICCV, 2021.

Code for CVPR2019 paper《Unequal Training for Deep Face Recognition with Long Tailed Noisy Data》

Efficient Sparse Attacks on Videos using Reinforcement Learning