EfficientNetV2 implementation using PyTorch

Last update: Dec 29, 2022

Overview

EfficientNetV2-S implementation using PyTorch

Train Steps

Configure imagenet path by changing data_dir in train.py
python main.py --benchmark for model information
python -m torch.distributed.launch --nproc_per_node=$ main.py --train for training model, $ is number of GPUs
python main.py --test for testing

Note

The model achieved 82.7 top-1 after 150 epochs

Number of parameters: 23941296
Time per operator type:
        778.049 ms.    70.6258%. Conv
        255.227 ms.    23.1677%. Sigmoid
          56.91 ms.    5.16589%. Mul
         6.1573 ms.   0.558916%. Add
        4.69289 ms.   0.425987%. ReduceMean
       0.613303 ms.  0.0556713%. FC
        1101.65 ms in Total
FLOP per operator type:
         17.277 GFLOP.    99.7074%. Conv
      0.0419251 GFLOP.   0.241954%. Mul
     0.00519322 GFLOP.  0.0299706%. Add
       0.003585 GFLOP.  0.0206894%. FC
        17.3277 GFLOP in Total
Feature Memory Read per operator type:
        295.875 MB.    50.5134%. Mul
        241.136 MB.     41.168%. Conv
        41.5457 MB.     7.0929%. Add
        7.17917 MB.    1.22567%. FC
        585.737 MB in Total
Feature Memory Written per operator type:
          167.7 MB.    49.2361%. Mul
        152.127 MB.    44.6639%. Conv
        20.7729 MB.    6.09882%. Add
          0.004 MB. 0.00117438%. FC
        340.605 MB in Total
Parameter Memory per operator type:
        87.8034 MB.    92.4486%. Conv
          7.172 MB.    7.55143%. FC
              0 MB.          0%. Add
              0 MB.          0%. Mul
        94.9754 MB in Total

EfficientNetV2 implementation using PyTorch

Related tags

Overview

Train Steps

Note

Owner

Jahongir Yunusov

Sync2Gen Code for ICCV 2021 paper: Scene Synthesis via Uncertainty-Driven Attribute Synchronization

This is an example implementation of the paper "Cross Domain Robot Imitation with Invariant Representation".

PyElastica is the Python implementation of Elastica, an open-source software for the simulation of assemblies of slender, one-dimensional structures using Cosserat Rod theory.

A copy of Ares that costs 30 fucking dollars.

City-Scale Multi-Camera Vehicle Tracking Guided by Crossroad Zones Code

Code for the ICML 2021 paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

Deep learning PyTorch library for time series forecasting, classification, and anomaly detection

ShinRL: A Library for Evaluating RL Algorithms from Theoretical and Practical Perspectives

deep learning for image processing including classification and object-detection etc.

To Design and Implement Logistic Regression to Classify Between Benign and Malignant Cancer Types

A Python Library for Graph Outlier Detection (Anomaly Detection)

Aalto-cs-msc-theses - Listing of M.Sc. Theses of the Department of Computer Science at Aalto University

ElasticFace: Elastic Margin Loss for Deep Face Recognition

Code for Universal Semi-Supervised Semantic Segmentation models paper accepted in ICCV 2019

Measuring and Improving Consistency in Pretrained Language Models

Learning Intents behind Interactions with Knowledge Graph for Recommendation, WWW2021

CRLT: A Unified Contrastive Learning Toolkit for Unsupervised Text Representation Learning

Pytorch implementation of ProjectedGAN

Sequence modeling benchmarks and temporal convolutional networks

NVIDIA container runtime