RVT: Robust Vision Transformers
This repository contains PyTorch code for Robust Vision Transformers.
For details see Rethinking the Design Principles of Robust Vision Transformer by Xiaofeng Mao, Gege Qi, Yuefeng Chen, Yuan He and Hui Xue.
Usage
First, clone the repository locally:
git clone https://github.com/vtddggg/Robust-Vision-Transformer.git
Then, install PyTorch 1.7.0+ and torchvision 0.8.1+ and pytorch-image-models 0.3.2:
conda install -c pytorch pytorch torchvision
pip install timm==0.3.2
We use 4 nodes with 8 gpus to train RVT-Ti, RVT-S and RVT-B:
Training RVT-Ti
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_tiny --data-path /path/to/imagenet --output_dir output --dist-eval
Training RVT-S
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_small --data-path /path/to/imagenet --output_dir output --dist-eval
Training RVT-B
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_base --data-path /path/to/imagenet --output_dir output --batch-size 32 --dist-eval
If you want to train RVT-Ti*, RVT-S* or RVT-B*, simply add --use_mask and --use_patch_aug to enable positon-aware attention scaling and patch-wise augmentation.
36 Nov 23, 2022
34 Apr 13, 2022
62 Dec 09, 2022
39 Dec 25, 2022
119 Jan 04, 2023
35 Dec 14, 2022
66 Dec 26, 2022
58 Dec 30, 2022
482 Dec 18, 2022
2.7k Jan 07, 2023
7 Dec 27, 2021
24 Apr 15, 2021
30 Jan 01, 2023
0 Nov 01, 2022
67 Nov 28, 2022
0 Dec 23, 2021
211 Jan 02, 2023
40 Oct 30, 2022
4 Dec 03, 2022
126 Dec 30, 2022