EfficientNetV2 implementation using PyTorch

Last update: Dec 29, 2022

Overview

EfficientNetV2-S implementation using PyTorch

Train Steps

Configure imagenet path by changing data_dir in train.py
python main.py --benchmark for model information
python -m torch.distributed.launch --nproc_per_node=$ main.py --train for training model, $ is number of GPUs
python main.py --test for testing

Note

The model achieved 82.7 top-1 after 150 epochs

Number of parameters: 23941296
Time per operator type:
        778.049 ms.    70.6258%. Conv
        255.227 ms.    23.1677%. Sigmoid
          56.91 ms.    5.16589%. Mul
         6.1573 ms.   0.558916%. Add
        4.69289 ms.   0.425987%. ReduceMean
       0.613303 ms.  0.0556713%. FC
        1101.65 ms in Total
FLOP per operator type:
         17.277 GFLOP.    99.7074%. Conv
      0.0419251 GFLOP.   0.241954%. Mul
     0.00519322 GFLOP.  0.0299706%. Add
       0.003585 GFLOP.  0.0206894%. FC
        17.3277 GFLOP in Total
Feature Memory Read per operator type:
        295.875 MB.    50.5134%. Mul
        241.136 MB.     41.168%. Conv
        41.5457 MB.     7.0929%. Add
        7.17917 MB.    1.22567%. FC
        585.737 MB in Total
Feature Memory Written per operator type:
          167.7 MB.    49.2361%. Mul
        152.127 MB.    44.6639%. Conv
        20.7729 MB.    6.09882%. Add
          0.004 MB. 0.00117438%. FC
        340.605 MB in Total
Parameter Memory per operator type:
        87.8034 MB.    92.4486%. Conv
          7.172 MB.    7.55143%. FC
              0 MB.          0%. Add
              0 MB.          0%. Mul
        94.9754 MB in Total

EfficientNetV2 implementation using PyTorch

Related tags

Overview

Train Steps

Note

Owner

Jahongir Yunusov

The aim of the game, as in the original one, is to find a specific image from a group of different images of a person's face

Unsupervised Image to Image Translation with Generative Adversarial Networks

The official implementation of CircleNet: Anchor-free Detection with Circle Representation, MICCAI 2030

sequitur is a library that lets you create and train an autoencoder for sequential data in just two lines of code

PyTorch Code for NeurIPS 2021 paper Anti-Backdoor Learning: Training Clean Models on Poisoned Data.

FaceAPI: AI-powered Face Detection & Rotation Tracking, Face Description & Recognition, Age & Gender & Emotion Prediction for Browser and NodeJS using TensorFlow/JS

This project provides the code and datasets for 'CapSal: Leveraging Captioning to Boost Semantics for Salient Object Detection', CVPR 2019.

Just playing with getting CLIP Guided Diffusion running locally, rather than having to use colab.

Freecodecamp Scientific Computing with Python Certification; Solution for Challenge 2: Time Calculator

VGGVox models for Speaker Identification and Verification trained on the VoxCeleb (1 & 2) datasets

Swin-Transformer is basically a hierarchical Transformer whose representation is computed with shifted windows.

Pytorch implementation of MaskGIT: Masked Generative Image Transformer

This repo is customed for VisDrone.

The official codes for the ICCV2021 presentation "Uniformity in Heterogeneity: Diving Deep into Count Interval Partition for Crowd Counting"

A machine learning malware analysis framework for Android apps.

EMNLP 2021 Findings' paper, SCICAP: Generating Captions for Scientific Figures

In this project, we create and implement a deep learning library from scratch.

Introduction to Statistics and Basics of Mathematics for Data Science - The Hacker's Way

Self Driving RC Car Code

This is a TensorFlow implementation for C2-Rec