TraND: Transferable Neighborhood Discovery for Unsupervised Cross-domain Gait Recognition.

Last update: Apr 04, 2022

Overview

TraND

This is the code for the paper "Jinkai Zheng, Xinchen Liu, Chenggang Yan, Jiyong Zhang, Wu Liu, Xiaoping Zhang and Tao Mei: TraND: Transferable Neighborhood Discovery for Unsupervised Cross-domain Gait Recognition. ISCAS 2021"

Requirements

Conda
GPUs
Python 3.7
PyTorch 1.1.0

Installation

You can replace the second command from the bottom to install pytorch based on your CUDA version.

git clone https://github.com/JinkaiZheng/TraND.git
cd TraND
conda create --name py37torch110 python=3.7
conda activate py37torch110
conda install pytorch==1.1.0 torchvision==0.3.0 cudatoolkit=10.0 -c pytorch
pip install -r requirements

Data Preparation

Download CASIA-B and OU-LP

Data Pretreatment

pretreatment_casia.py and pretreatment_oulp.py use the alignment method in this paper. In the case of CASIA-B dataset, you need to run the command:

python GaitSet/pretreatment_casia.py --input_path='root_path_of_raw_dataset' --output_path='./data/CASIA-B'

Data Structrue

After the pretreatment, the data structure under the directory should like this

./data
├── CASIA-B
│  ├── 001
│     ├── bg-01
│        ├── 000
│           └── 001-bg-01-000-001.png
├── OULP
│  ├── 0000024
│     ├── Seq00
│        ├── 55
            └── 00000061.png

Train

Stage I: Supervised Prior Knowledge Learning on Source Domain

Training the GaitSet model in the source domain, run this command:

 python GaitSet/train.py --data "casia-b"

Stage II: Transferable Neighbor Discovery on Target Domain

Fine-tuning the GaitSet model in the target domain with TraND method, run this command:

sh Experement.sh

Test

Testing the model in self domain, such as CASIA-B dataset, run this command:

python GaitSet/test.py --data "casia-b"

Testing the model in cross domain, such as CASIA-B -> OU-LP dataset, run this command:

python GaitSet/test_cross.py --source "casia-b" --target "oulp"

Citation

Please cite this paper in your publications if it helps your research:

@article{DBLP:journals/corr/abs-2102-04621,
  author    = {Jinkai Zheng and
               Xinchen Liu and
               Chenggang Yan and
               Jiyong Zhang and
               Wu Liu and
               Xiaoping Zhang and
               Tao Mei},
  title     = {TraND: Transferable Neighborhood Discovery for Unsupervised Cross-domain
               Gait Recognition},
  journal   = {ISCAS},
  year      = {2021}
}

Acknowledgement

GaitSet
AND

KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control

KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control Tomas Jakab, Richard Tucker, Ameesh Makadia, Jiajun Wu, Noah Snavely, Angjoo Ka

87 Nov 30, 2022

Unsupervised Discovery of Object Radiance Fields

Unsupervised Discovery of Object Radiance Fields by Hong-Xing Yu, Leonidas J. Guibas and Jiajun Wu from Stanford University. arXiv link: https://arxiv

148 Nov 30, 2022

Pytorch implementation of the unsupervised object discovery method LOST.

LOST Pytorch implementation of the unsupervised object discovery method LOST. More details can be found in the paper: Localizing Objects with Self-Sup

189 Dec 25, 2022

Code for SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics (ACL'2020).

SentiBERT Code for SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics (ACL'2020). https://arxiv.org/abs/20

66 Aug 13, 2022

CLIP: Connecting Text and Image (Learning Transferable Visual Models From Natural Language Supervision)

CLIP (Contrastive Language–Image Pre-training) Experiments (Evaluation) Model Dataset Acc (%) ViT-B/32 (Paper) CIFAR100 65.1 ViT-B/32 (Our) CIFAR100 6

52 Jan 7, 2023

Official repository for "On Generating Transferable Targeted Perturbations" (ICCV 2021)

On Generating Transferable Targeted Perturbations (ICCV'21) Muzammal Naseer, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, and Fatih Porikli Paper:

46 Nov 17, 2022

TransPrompt - Towards an Automatic Transferable Prompting Framework for Few-shot Text Classification

TransPrompt This code is implement for our EMNLP 2021's paper 《TransPrompt：Towards an Automatic Transferable Prompting Framework for Few-shot Text Cla

23 Dec 21, 2022

Cross Quality LFW: A database for Analyzing Cross-Resolution Image Face Recognition in Unconstrained Environments

Cross-Quality Labeled Faces in the Wild (XQLFW) Here, we release the database, evaluation protocol and code for the following paper: Cross Quality LFW

10 Dec 12, 2022

“Data Augmentation for Cross-Domain Named Entity Recognition” (EMNLP 2021)

Data Augmentation for Cross-Domain Named Entity Recognition Authors: Shuguang Chen, Gustavo Aguilar, Leonardo Neves and Thamar Solorio This repository

18 Sep 10, 2022

Releases(V0.1)

V0.1(Sep 27, 2021)
CASIA_best_encoder.ptm: The best model of GaitSet model trained on the CASIA-B dataset.

OULP_best_encoder.ptm: The best model of GaitSet model trained on the OU-LP dataset.

CASIA2OULP_best_encoder.ptm: The best model of TraND model trained on the CASIA-B dataset and tested on the OU-LP dataset.

OULP2CASIA_best_encoder.ptm: The best model of TraND model trained on the OU-LP dataset and tested on the CASIA-B dataset.

Source code(tar.gz)
Source code(zip)
CASIA2OULP_best_encoder.ptm(24.08 MB)
CASIA_best_encoder.ptm(24.08 MB)
OULP2CASIA_best_encoder.ptm(24.08 MB)
OULP_best_encoder.ptm(24.08 MB)
segmentation_hrnet_best_model.pth(251.88 MB)

TraND: Transferable Neighborhood Discovery for Unsupervised Cross-domain Gait Recognition.

Related tags

Overview

TraND

Requirements

Installation

Data Preparation

Data Pretreatment

Data Structrue

Train

Stage I: Supervised Prior Knowledge Learning on Source Domain

Stage II: Transferable Neighbor Discovery on Target Domain

Test

Citation

Acknowledgement

You might also like...

KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control

Unsupervised Discovery of Object Radiance Fields

Pytorch implementation of the unsupervised object discovery method LOST.

Code for SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics (ACL'2020).

CLIP: Connecting Text and Image (Learning Transferable Visual Models From Natural Language Supervision)

Official repository for "On Generating Transferable Targeted Perturbations" (ICCV 2021)

TransPrompt - Towards an Automatic Transferable Prompting Framework for Few-shot Text Classification

Cross Quality LFW: A database for Analyzing Cross-Resolution Image Face Recognition in Unconstrained Environments

“Data Augmentation for Cross-Domain Named Entity Recognition” (EMNLP 2021)

Releases(V0.1)

V0.1(Sep 27, 2021)

Owner

Jinkai Zheng

This is the implementation of "SELF SUPERVISED REPRESENTATION LEARNING WITH DEEP CLUSTERING FOR ACOUSTIC UNIT DISCOVERY FROM RAW SPEECH" submitted to ICASSP 2022

Code for the TPAMI paper: "Syntax Customized Video Captioning by Imitating Exemplar Sentences"

Model of an AI powered sign language interpreter.

Official implementation of "Can You Spot the Chameleon? Adversarially Camouflaging Images from Co-Salient Object Detection" in CVPR 2022.

Discord-Protect is a simple discord bot allowing you to have some security on your discord server by ordering a captcha to the user who joins your server.

FCAF3D: Fully Convolutional Anchor-Free 3D Object Detection

Reference implementation of code generation projects from Facebook AI Research. General toolkit to apply machine learning to code, from dataset creation to model training and evaluation. Comes with pretrained models.

Amazon Forest Computer Vision: Satellite Image tagging code using PyTorch / Keras with lots of PyTorch tricks

NNR conformation conditional and global probabilities estimation and analysis in peptides or proteins fragments

Deep Learning for humans

Reusable constraint types to use with typing.Annotated

scikit-learn: machine learning in Python

Simple tool to combine(merge) onnx models. Simple Network Combine Tool for ONNX.

Text mining project; Using distilBERT to predict authors in the classification task authorship attribution.

Region-aware Contrastive Learning for Semantic Segmentation, ICCV 2021

This project deploys a yolo fastest model in the form of tflite on raspberry 3b+. The model is from another repository of mine called -Trash-Classification-Car

Segmentation Training Pipeline

CAMoE + Dual SoftMax Loss (DSL): Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss

Simple Tensorflow implementation of "Adaptive Convolutions for Structure-Aware Style Transfer" (CVPR 2021)

Supervised forecasting of sequential data in Python.