EfficientNetV2 implementation using PyTorch

Last update: Dec 29, 2022

Overview

EfficientNetV2-S implementation using PyTorch

Train Steps

Configure imagenet path by changing data_dir in train.py
python main.py --benchmark for model information
python -m torch.distributed.launch --nproc_per_node=$ main.py --train for training model, $ is number of GPUs
python main.py --test for testing

Note

The model achieved 82.7 top-1 after 150 epochs

Number of parameters: 23941296
Time per operator type:
        778.049 ms.    70.6258%. Conv
        255.227 ms.    23.1677%. Sigmoid
          56.91 ms.    5.16589%. Mul
         6.1573 ms.   0.558916%. Add
        4.69289 ms.   0.425987%. ReduceMean
       0.613303 ms.  0.0556713%. FC
        1101.65 ms in Total
FLOP per operator type:
         17.277 GFLOP.    99.7074%. Conv
      0.0419251 GFLOP.   0.241954%. Mul
     0.00519322 GFLOP.  0.0299706%. Add
       0.003585 GFLOP.  0.0206894%. FC
        17.3277 GFLOP in Total
Feature Memory Read per operator type:
        295.875 MB.    50.5134%. Mul
        241.136 MB.     41.168%. Conv
        41.5457 MB.     7.0929%. Add
        7.17917 MB.    1.22567%. FC
        585.737 MB in Total
Feature Memory Written per operator type:
          167.7 MB.    49.2361%. Mul
        152.127 MB.    44.6639%. Conv
        20.7729 MB.    6.09882%. Add
          0.004 MB. 0.00117438%. FC
        340.605 MB in Total
Parameter Memory per operator type:
        87.8034 MB.    92.4486%. Conv
          7.172 MB.    7.55143%. FC
              0 MB.          0%. Add
              0 MB.          0%. Mul
        94.9754 MB in Total

EfficientNetV2 implementation using PyTorch

Related tags

Overview

Train Steps

Note

Owner

Jahongir Yunusov

We envision models that are pre-trained on a vast range of domain-relevant tasks to become key for molecule property prediction

Autonomous Ground Vehicle Navigation and Control Simulation Examples in Python

Flax is a neural network ecosystem for JAX that is designed for flexibility.

Semantic Image Synthesis with SPADE

Code for "Single-view robot pose and joint angle estimation via render & compare", CVPR 2021 (Oral).

Jittor Medical Segmentation Lib -- The assignment of Pattern Recognition course (2021 Spring) in Tsinghua University

This is the code for the paper "Jinkai Zheng, Xinchen Liu, Wu Liu, Lingxiao He, Chenggang Yan, Tao Mei: Gait Recognition in the Wild with Dense 3D Representations and A Benchmark. (CVPR 2022)"

AtlasNet: A Papier-Mâché Approach to Learning 3D Surface Generation

Resources complimenting the Machine Learning Course led in the Faculty of mathematics and informatics part of Sofia University.

一个目标检测的通用框架(不需要cuda编译)，支持Yolo全系列(v2~v5)、EfficientDet、RetinaNet、Cascade-RCNN等SOTA网络。

This is the official PyTorch implementation of the paper "TransFG: A Transformer Architecture for Fine-grained Recognition" (Ju He, Jie-Neng Chen, Shuai Liu, Adam Kortylewski, Cheng Yang, Yutong Bai, Changhu Wang, Alan Yuille).

A curated list of awesome neural radiance fields papers

Code for "On the Effects of Batch and Weight Normalization in Generative Adversarial Networks"

Save-restricted-v-3 - Save restricted content Bot For telegram

Object Detection using YOLO from PyImageSearch

This repository contains tutorials for the py4DSTEM Python package

Distributed Deep learning with Keras & Spark

PyTorch code for the NAACL 2021 paper "Improving Generation and Evaluation of Visual Stories via Semantic Consistency"

Project page of the paper 'Analyzing Perception-Distortion Tradeoff using Enhanced Perceptual Super-resolution Network' (ECCVW 2018)

Source code for From Stars to Subgraphs