PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Last update: Dec 18, 2022

Overview

octconv.pytorch

PyTorch implementation of Octave Convolution in Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution

ResNet-50/101 on ImageNet

Architecture	LR decay strategy	Parameters	GFLOPs	Top-1 / Top-5 Accuracy (%)
ResNet-50	step (90 epochs)	25.557M	4.089	76.010 / 92.834
ResNet-50	cosine (120 epochs)	25.557M	4.089	77.150 / 93.468
Oct-ResNet-50 (alpha=0.5)	cosine (120 epochs)	25.557M	2.367	77.640 / 93.662
ResNet-101	cosine (120 epochs)	44.549M	7.801	78.898 / 94.304
Oct-ResNet-101 (alpha=0.5)	cosine (120 epochs)	44.549M	3.991	78.794 / 94.330
ResNet-152	cosine (120 epochs)	60.193M	11.514	79.234 / 94.556
Oct-ResNet-152 (alpha=0.5)	cosine (120 epochs)	60.193M	5.615	79.258 / 94.480

MobileNet V1 on ImageNet

Architecture	LR decay strategy	Parameters	FLOPs	Top-1 / Top-5 Accuracy (%)
MobileNetV1	cosine (150 epochs)	4.232M	568.7M	72.238 / 90.536
Oct-MobileNetV1	cosine (150 epochs)	4.232M	318.2M	71.254 / 89.728

Acknowledgement

Official MXNet implmentation by @cypw

Citation

@InProceedings{Chen_2019_ICCV,
author = {Chen, Yunpeng and Fan, Haoqi and Xu, Bing and Yan, Zhicheng and Kalantidis, Yannis and Rohrbach, Marcus and Yan, Shuicheng and Feng, Jiashi},
title = {Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave Convolution},
booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
month = {October},
year = {2019}
}

PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Related tags

Overview

octconv.pytorch

ResNet-50/101 on ImageNet

MobileNet V1 on ImageNet

Acknowledgement

Citation

Owner

Duo Li

Rethinking Nearest Neighbors for Visual Classification

ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training

Supervised Contrastive Learning for Product Matching

Multi Agent Reinforcement Learning for ROS in 2D Simulation Environments

Official implementation of NPMs: Neural Parametric Models for 3D Deformable Shapes - ICCV 2021

Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On

Implementation of PersonaGPT Dialog Model

Pytorch implementation of the Variational Recurrent Neural Network (VRNN).

[CVPR'21] Learning to Recommend Frame for Interactive Video Object Segmentation in the Wild

The official repository for "Revealing unforeseen diagnostic image features with deep learning by detecting cardiovascular diseases from apical four-chamber ultrasounds"

A brand new hub for Scene Graph Generation methods based on MMdetection (2021). The pipeline of from detection, scene graph generation to downstream tasks (e.g., image cpationing) is supported. Pytorch version implementation of HetH (ECCV 2020) and TopicSG (ICCV 2021) is included.

RealTime Emotion Recognizer for Machine Learning Study Jam's demo

Official Pytorch implementation of "DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network" (CVPR'21)

git《Beta R-CNN: Looking into Pedestrian Detection from Another Perspective》(NeurIPS 2020) GitHub:[fig3]

Can we learn gradients by Hamiltonian Neural Networks?

RuleBERT: Teaching Soft Rules to Pre-Trained Language Models

Adaptive Denoising Training (ADT) for Recommendation.

A particular navigation route using satellite feed and can help in toll operations & traffic managemen

Code for the paper: Sketch Your Own GAN

ISBI 2022: Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image.