PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Last update: Dec 18, 2022

Overview

octconv.pytorch

PyTorch implementation of Octave Convolution in Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution

ResNet-50/101 on ImageNet

Architecture	LR decay strategy	Parameters	GFLOPs	Top-1 / Top-5 Accuracy (%)
ResNet-50	step (90 epochs)	25.557M	4.089	76.010 / 92.834
ResNet-50	cosine (120 epochs)	25.557M	4.089	77.150 / 93.468
Oct-ResNet-50 (alpha=0.5)	cosine (120 epochs)	25.557M	2.367	77.640 / 93.662
ResNet-101	cosine (120 epochs)	44.549M	7.801	78.898 / 94.304
Oct-ResNet-101 (alpha=0.5)	cosine (120 epochs)	44.549M	3.991	78.794 / 94.330
ResNet-152	cosine (120 epochs)	60.193M	11.514	79.234 / 94.556
Oct-ResNet-152 (alpha=0.5)	cosine (120 epochs)	60.193M	5.615	79.258 / 94.480

MobileNet V1 on ImageNet

Architecture	LR decay strategy	Parameters	FLOPs	Top-1 / Top-5 Accuracy (%)
MobileNetV1	cosine (150 epochs)	4.232M	568.7M	72.238 / 90.536
Oct-MobileNetV1	cosine (150 epochs)	4.232M	318.2M	71.254 / 89.728

Acknowledgement

Official MXNet implmentation by @cypw

Citation

@InProceedings{Chen_2019_ICCV,
author = {Chen, Yunpeng and Fan, Haoqi and Xu, Bing and Yan, Zhicheng and Kalantidis, Yannis and Rohrbach, Marcus and Yan, Shuicheng and Feng, Jiashi},
title = {Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave Convolution},
booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
month = {October},
year = {2019}
}

PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Related tags

Overview

octconv.pytorch

ResNet-50/101 on ImageNet

MobileNet V1 on ImageNet

Acknowledgement

Citation

Owner

Duo Li

FedTorch is an open-source Python package for distributed and federated training of machine learning models using PyTorch distributed API

Using PyTorch Perform intent classification using three different models to see which one is better for this task

Supervised Contrastive Learning for Product Matching

To SMOTE, or not to SMOTE?

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Code for reproducible experiments presented in KSD Aggregated Goodness-of-fit Test.

Code for paper "Document-Level Argument Extraction by Conditional Generation". NAACL 21'

EMNLP 2021: Single-dataset Experts for Multi-dataset Question-Answering

Our VMAgent is a platform for exploiting Reinforcement Learning (RL) on Virtual Machine (VM) scheduling tasks.

Fake videos detection by tracing the source using video hashing retrieval.

ML course - EPFL Machine Learning Course, Fall 2021

Code for the paper: Adversarial Training Against Location-Optimized Adversarial Patches. ECCV-W 2020.

Temporal Knowledge Graph Reasoning Triggered by Memories

Repository for code and dataset for our EMNLP 2021 paper - “So You Think You’re Funny?”: Rating the Humour Quotient in Standup Comedy.

Pytorch implementation of our paper under review -- 1xN Pattern for Pruning Convolutional Neural Networks

An official PyTorch Implementation of Boundary-aware Self-supervised Learning for Video Scene Segmentation (BaSSL)

Code for the ICML 2021 paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

The repository is for safe reinforcement learning baselines.

M2MRF: Many-to-Many Reassembly of Features for Tiny Lesion Segmentation in Fundus Images

The sixth place winning solution (6/220) in 2021 Gaofen Challenge.