PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Last update: Dec 18, 2022

Overview

octconv.pytorch

PyTorch implementation of Octave Convolution in Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution

ResNet-50/101 on ImageNet

Architecture	LR decay strategy	Parameters	GFLOPs	Top-1 / Top-5 Accuracy (%)
ResNet-50	step (90 epochs)	25.557M	4.089	76.010 / 92.834
ResNet-50	cosine (120 epochs)	25.557M	4.089	77.150 / 93.468
Oct-ResNet-50 (alpha=0.5)	cosine (120 epochs)	25.557M	2.367	77.640 / 93.662
ResNet-101	cosine (120 epochs)	44.549M	7.801	78.898 / 94.304
Oct-ResNet-101 (alpha=0.5)	cosine (120 epochs)	44.549M	3.991	78.794 / 94.330
ResNet-152	cosine (120 epochs)	60.193M	11.514	79.234 / 94.556
Oct-ResNet-152 (alpha=0.5)	cosine (120 epochs)	60.193M	5.615	79.258 / 94.480

MobileNet V1 on ImageNet

Architecture	LR decay strategy	Parameters	FLOPs	Top-1 / Top-5 Accuracy (%)
MobileNetV1	cosine (150 epochs)	4.232M	568.7M	72.238 / 90.536
Oct-MobileNetV1	cosine (150 epochs)	4.232M	318.2M	71.254 / 89.728

Acknowledgement

Official MXNet implmentation by @cypw

Citation

@InProceedings{Chen_2019_ICCV,
author = {Chen, Yunpeng and Fan, Haoqi and Xu, Bing and Yan, Zhicheng and Kalantidis, Yannis and Rohrbach, Marcus and Yan, Shuicheng and Feng, Jiashi},
title = {Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave Convolution},
booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
month = {October},
year = {2019}
}

PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Related tags

Overview

octconv.pytorch

ResNet-50/101 on ImageNet

MobileNet V1 on ImageNet

Acknowledgement

Citation

Owner

Duo Li

PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)

TensorFlow-LiveLessons - "Deep Learning with TensorFlow" LiveLessons

StyleGAN2-ada for practice

Denoising Diffusion Probabilistic Models

The code of "Dependency Learning for Legal Judgment Prediction with a Unified Text-to-Text Transformer".

Cognate Detection Repository

This repository is the code of the paper Accelerating Deep Reinforcement Learning for Digital Twin Network Optimization with Evolutionary Strategies

The deployment framework aims to provide a simple, lightweight, fast integrated, pipelined deployment framework that ensures reliability, high concurrency and scalability of services.

Implicit Graph Neural Networks

Code for paper " AdderNet: Do We Really Need Multiplications in Deep Learning?"

Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding

Deep Learning for Time Series Classification

The project of phase's key role in complex and real NN

Organseg dags - The repository contains the codebase for multi-organ segmentation with directed acyclic graphs (DAGs) in CT.

Send text to girlfriend in the morning

Mining-the-Social-Web-3rd-Edition - The official online compendium for Mining the Social Web, 3rd Edition (O'Reilly, 2018)

HandFoldingNet ✌️ : A 3D Hand Pose Estimation Network Using Multiscale-Feature Guided Folding of a 2D Hand Skeleton

Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"

TVNet: Temporal Voting Network for Action Localization

Diffusion Normalizing Flow (DiffFlow) Neurips2021