Adjust Decision Boundary for Class Imbalanced Learning

Overview

Adjusting Decision Boundary for Class Imbalanced Learning

This repository is the official PyTorch implementation of WVN-RS, introduced in Adjusting Decision Boundary for Class Imbalanced Learning.

Requirements

  1. NVIDIA docker : Docker image will be pulled from cloud.
  2. CIFAR dataset : The "dataset_path" in run_cifar.sh should be
cifar10/
    data_batch_N
    test_batch
cifar100/
    train
    test

CIFAR datasets are available here.

How to use

Run the shell script.

bash run_cifar.sh

To use Weight Vector Normalization (WVN), use --WVN flag. (It is already in the script.)

Results

  1. Validation error on Long-Tailed CIFAR10
Imbalance 200 100 50 20 10 1
Baseline 35.67 29.71 22.91 16.04 13.26 6.83
Over-sample 32.19 28.27 21.40 15.23 12.24 6.61
Focal 34.71 29.62 23.28 16.77 13.19 6.60
CB 31.11 25.43 20.73 15.64 12.51 6.36
LDAM-DRW 28.09 22.97 17.83 14.53 11.84 6.32
Baseline+RS 27.02 21.36 17.16 13.46 11.86 6.32
WVN+RS 27.23 20.17 16.80 12.76 10.71 6.29
  1. Validation error on Long-Tailed CIFAR100
Imbalance 200 100 50 20 10 1
Baseline 64.21 60.38 55.09 48.93 43.52 29.69
Over-sample 66.39 61.53 56.65 49.03 43.38 29.41
Focal 64.38 61.31 55.68 48.05 44.22 28.52
CB 63.77 60.40 54.68 47.41 42.01 28.39
LDAM-DRW 61.73 57.96 52.54 47.14 41.29 28.85
Baseline+RS 59.59 55.65 51.91 45.09 41.45 29.80
WVN+RS 59.48 55.50 51.80 46.12 41.02 29.22

Notes

This codes use docker image "feidfoe/pytorch:v.2" with pytorch version, '0.4.0a0+0640816'. The image only provides basic libraries such as NumPy or PIL.

WVN is implemented on ResNet architecture only.

Baseline repository

This repository is forked and modified from original repo.

Contact

Byungju Kim ([email protected])

BibTeX for Citation

@ARTICLE{9081988,
  author={B. {Kim} and J. {Kim}},
  journal={IEEE Access}, 
  title={Adjusting Decision Boundary for Class Imbalanced Learning}, 
  year={2020},
  volume={8},
  number={},
  pages={81674-81685},}
Owner
Peyton Byungju Kim
Peyton Byungju Kim
🦙 LaMa Image Inpainting, Resolution-robust Large Mask Inpainting with Fourier Convolutions, WACV 2022

🦙 LaMa Image Inpainting, Resolution-robust Large Mask Inpainting with Fourier Convolutions, WACV 2022

Advanced Image Manipulation Lab @ Samsung AI Center Moscow 4.7k Dec 31, 2022
Differentiable molecular simulation of proteins with a coarse-grained potential

Differentiable molecular simulation of proteins with a coarse-grained potential This repository contains the learned potential, simulation scripts and

UCL Bioinformatics Group 44 Dec 10, 2022
links and status of cool gradio demos

awesome-demos This is a list of some wonderful demos & applications built with Gradio. Here's how to contribute yours! 🖊️ Natural language processing

Gradio 96 Dec 30, 2022
A PyTorch implementation of SIN: Superpixel Interpolation Network

SIN: Superpixel Interpolation Network This is is a PyTorch implementation of the superpixel segmentation network introduced in our PRICAI-2021 paper:

6 Sep 28, 2022
Curvlearn, a Tensorflow based non-Euclidean deep learning framework.

English | 简体中文 Why Non-Euclidean Geometry Considering these simple graph structures shown below. Nodes with same color has 2-hop distance whereas 1-ho

Alibaba 123 Dec 12, 2022
Unofficial pytorch implementation of paper "One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing"

One-Shot Free-View Neural Talking Head Synthesis Unofficial pytorch implementation of paper "One-Shot Free-View Neural Talking-Head Synthesis for Vide

ZLH 406 Dec 23, 2022
HiFi++: a Unified Framework for Neural Vocoding, Bandwidth Extension and Speech Enhancement

HiFi++ : a Unified Framework for Neural Vocoding, Bandwidth Extension and Speech Enhancement This is the unofficial implementation of Vocoder part of

Rishikesh (ऋषिकेश) 118 Dec 29, 2022
This repository contains demos I made with the Transformers library by HuggingFace.

Transformers-Tutorials Hi there! This repository contains demos I made with the Transformers library by 🤗 HuggingFace. Currently, all of them are imp

3.5k Jan 01, 2023
UNet model with VGG11 encoder pre-trained on Kaggle Carvana dataset

TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation By Vladimir Iglovikov and Alexey Shvets Introduction TernausNet is

Vladimir Iglovikov 1k Dec 28, 2022
Implementation of Uformer, Attention-based Unet, in Pytorch

Uformer - Pytorch Implementation of Uformer, Attention-based Unet, in Pytorch. It will only offer the concat-cross-skip connection. This repository wi

Phil Wang 72 Dec 19, 2022
MM1 and MMC Queue Simulation using python - Results and parameters in excel and csv files

implementation of MM1 and MMC Queue on randomly generated data and evaluate simulation results then compare with analytical results and draw a plot curve for them, simulate some integrals and compare

Mohamadreza Rezaei 1 Jan 19, 2022
Official Repository for our ECCV2020 paper: Imbalanced Continual Learning with Partitioning Reservoir Sampling

Imbalanced Continual Learning with Partioning Reservoir Sampling This repository contains the official PyTorch implementation and the dataset for our

Chris Dongjoo Kim 40 Sep 18, 2022
X-modaler is a versatile and high-performance codebase for cross-modal analytics.

X-modaler X-modaler is a versatile and high-performance codebase for cross-modal analytics. This codebase unifies comprehensive high-quality modules i

910 Dec 28, 2022
Get started learning C# with C# notebooks powered by .NET Interactive and VS Code.

.NET Interactive Notebooks for C# Welcome to the home of .NET interactive notebooks for C#! How to Install Download the .NET Coding Pack for VS Code f

.NET Platform 425 Dec 25, 2022
This is a simple backtesting framework to help you test your crypto currency trading. It includes a way to download and store historical crypto data and to execute a trading strategy.

You can use this simple crypto backtesting script to ensure your trading strategy is successful Minimal setup required and works well with static TP a

Andrei 154 Sep 12, 2022
Knowledge Distillation Toolbox for Semantic Segmentation

SegDistill: Toolbox for Knowledge Distillation on Semantic Segmentation Networks This repo contains the supported code and configuration files for Seg

9 Dec 12, 2022
Deep Multi-Magnification Network for multi-class tissue segmentation of whole slide images

Deep Multi-Magnification Network This repository provides training and inference codes for Deep Multi-Magnification Network published here. Deep Multi

Computational Pathology 12 Aug 06, 2022
The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation

PointNav-VO The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation Project Page | Paper Table of Contents Setup

Xiaoming Zhao 41 Dec 15, 2022
Implementation of Neural Distance Embeddings for Biological Sequences (NeuroSEED) in PyTorch

Neural Distance Embeddings for Biological Sequences Official implementation of Neural Distance Embeddings for Biological Sequences (NeuroSEED) in PyTo

Gabriele Corso 56 Dec 23, 2022
Implementations of polygamma, lgamma, and beta functions for PyTorch

lgamma Implementations of polygamma, lgamma, and beta functions for PyTorch. It's very hacky, but that's usually ok for research use. To build, run: .

Rachit Singh 24 Nov 09, 2021