Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Last update: Nov 25, 2022

Related tags

Deep Learning CMSF

Overview

CMSF

Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Requirements

Python >= 3.7.6
PyTorch >= 1.4
torchvision >= 0.5.0
faiss-gpu >= 1.6.1

Install PyTorch and ImageNet dataset following the official PyTorch ImageNet training code. We used Python 3.7 for our experiments.

Install PyTorch (pytorch.org)

To run NN and CMSF-KM, you require to install FAISS.

FAISS:

Install FAISS (https://github.com/facebookresearch/faiss/blob/master/INSTALL.md)

Training Self-Supservised CMSF-KM

python self_supervised/train_msf_km.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 5 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --num_clusters 50000 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

Training Self-Supservised CMSF-2Q

python self_supervised/train_msf_2q.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 5 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --topkp 5 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

Training Supservised

Following command can be used to train the CMSF(Supervised Learning)

python supervised/train_sup_msf.py \
  --cos \
  --weak_strong \
  --learning_rate 0.05 \
  --epochs 200 \
  --arch resnet50 \
  --topk 10 \
  --momentum 0.99 \
  --mem_bank_size 128000 \
  --checkpoint_path <CHECKPOINT PATH> \
  <DATASET PATH>

License

This project is under the MIT license.

Official Code for "Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning"

Related tags

Overview

CMSF

Requirements

Training Self-Supservised CMSF-KM

Training Self-Supservised CMSF-2Q

Training Supservised

License

Owner

Awesome Monocular 3D detection

Physics-Informed Neural Networks (PINN) and Deep BSDE Solvers of Differential Equations for Scientific Machine Learning (SciML) accelerated simulation

The code of "Dependency Learning for Legal Judgment Prediction with a Unified Text-to-Text Transformer".

Learning View Priors for Single-view 3D Reconstruction (CVPR 2019)

MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts (ICLR 2022)

PCACE: A Statistical Approach to Ranking Neurons for CNN Interpretability

This a classic fintech problem that introduces real life difficulties such as data imbalance. Check out the notebook to find out more!

Tf alloc - Simplication of GPU allocation for Tensorflow2

Replication of Pix2Seq with Pretrained Model

HairCLIP: Design Your Hair by Text and Reference Image

A PyTorch implementation of unsupervised SimCSE

ChainerRL is a deep reinforcement learning library built on top of Chainer.

A JAX implementation of Broaden Your Views for Self-Supervised Video Learning, or BraVe for short.

Official Implementation of Domain-Aware Universal Style Transfer

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

MADE (Masked Autoencoder Density Estimation) implementation in PyTorch

QRec: A Python Framework for quick implementation of recommender systems (TensorFlow Based)

A novel framework to automatically learn high-quality scanning of non-planar, complex anisotropic appearance.

PyTorch implementation of 'Gen-LaneNet: a generalized and scalable approach for 3D lane detection'

Official code of Team Yao at Multi-Modal-Fact-Verification-2022