Elucidating Robust Learning with Uncertainty-Aware Corruption Pattern Estimation

Overview

Elucidating Robust Learning with Uncertainty-Aware Corruption Pattern Estimation

Introduction

📋 Official implementation of Explainable Robust Learning MLNThis repository is official im the following paper:

Elucidating Robust Learning with Uncertainty-Aware Corruption Pattern Estimation

Arxiv

Our contributions are as follows

✔️ We propose a simple yet effective robust learning method leveraging a mixture of experts model on various noise settings.

✔️ The proposed method can not only robustly train from noisy data, but can also provide the explainability by discovering the underlying instance wise noise pattern within the dataset as well the two types of predictive uncertainties(aleatoric and epistemic)

✔️ We present a novel evaluation scheme for validating the set-dependent corruption pattern estimation performance.

Objective

Architecture

Requirements

torch==1.7.1
torchvision==0.8.2
matplotlib==3.4.1
scikit-learn==0.24.1
gensim==4.0.1
scipy==1.6.2
seaborn==0.11.1
Pillow==8.2.0

Datasets

Please download mannually TREC dataset

TREC TREC

Reproducing results of the paper

e.g., mnist on class conditional noise setting

mkdir ckpt
mkdir res
cd scripts
./ccn_mnist.sh

💡 Class Conditional Noise

CIFAR10

Flipping Rate F-correction Co-teaching Co-teaching+ JoCoR MLN(ours)
Symmetry-20% 68.74±0.20 78.23±0.27 78.71±0.34 85.73±0.19 84.20±0.05
Symmetry-50% 42.71±0.42 71.30±0.13 57.05±0.54 79.41±0.25 77.88±0.07
Symmetry-80% 15.88±0.42 26.58±2.22 24.19±2.74 27.78±3.06 41.83±0.10
Asymmetry-40% 70.60±0.40 73.78±0.22 68.84±0.20 76.36±0.49 76.62±0.07

Noise Transition Matrix on CIFAR10

💡 Set Dependent Noise

aleatoric uncertainty for the ambiguous set is higher than the clean set and larger for more label noise rate.

estimated noise transition matrix for partioned sets are:

Citing our paper

If you find this work useful please consider citing it:

@article{papername,
  title={title},
  author={authors},
  journal={arXiv preprint arXiv:xxxx.xxxxx},
  year={2021}
}
Owner
JeongEun Park
Interested in artificial intelligence and robotics
JeongEun Park
Official PyTorch Implementation of paper "NeLF: Neural Light-transport Field for Single Portrait View Synthesis and Relighting", EGSR 2021.

NeLF: Neural Light-transport Field for Single Portrait View Synthesis and Relighting Official PyTorch Implementation of paper "NeLF: Neural Light-tran

Ken Lin 38 Dec 26, 2022
This repository contains the source code of an efficient 1D probabilistic model for music time analysis proposed in ICASSP2022 venue.

Jump Reward Inference for 1D Music Rhythmic State Spaces An implementation of the probablistic jump reward inference model for music rhythmic informat

Mojtaba Heydari 25 Dec 16, 2022
Implements Stacked-RNN in numpy and torch with manual forward and backward functions

Recurrent Neural Networks Implements simple recurrent network and a stacked recurrent network in numpy and torch respectively. Both flavours implement

Vishal R 1 Nov 16, 2021
SafePicking: Learning Safe Object Extraction via Object-Level Mapping, ICRA 2022

SafePicking Learning Safe Object Extraction via Object-Level Mapping Kentaro Wad

Kentaro Wada 49 Oct 24, 2022
A PyTorch implementation of PointRend: Image Segmentation as Rendering

PointRend A PyTorch implementation of PointRend: Image Segmentation as Rendering [arxiv] [Official Implementation: Detectron2] This repo for Only Sema

AhnDW 336 Dec 26, 2022
pybaum provides tools to work with pytrees which is a concept burrowed from JAX.

pybaum provides tools to work with pytrees which is a concept burrowed from JAX.

Open Source Economics 9 May 11, 2022
SurfEmb (CVPR 2022) - SurfEmb: Dense and Continuous Correspondence Distributions

SurfEmb SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddings Rasmus Laurvig Haugard, A

Rasmus Haugaard 56 Nov 19, 2022
PyTorch implementation of an end-to-end Handwritten Text Recognition (HTR) system based on attention encoder-decoder networks

AttentionHTR PyTorch implementation of an end-to-end Handwritten Text Recognition (HTR) system based on attention encoder-decoder networks. Scene Text

Dmitrijs Kass 31 Dec 22, 2022
This repo is a PyTorch implementation for Paper "Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Clouds"

Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Clouds This repository is a PyTorch implementation for paper: Uns

Kaizhi Yang 42 Dec 09, 2022
Implementation of DocFormer: End-to-End Transformer for Document Understanding, a multi-modal transformer based architecture for the task of Visual Document Understanding (VDU)

DocFormer - PyTorch Implementation of DocFormer: End-to-End Transformer for Document Understanding, a multi-modal transformer based architecture for t

171 Jan 06, 2023
The official implementation of the research paper "DAG Amendment for Inverse Control of Parametric Shapes"

DAG Amendment for Inverse Control of Parametric Shapes This repository is the official Blender implementation of the paper "DAG Amendment for Inverse

Elie Michel 157 Dec 26, 2022
zeus is a Python implementation of the Ensemble Slice Sampling method.

zeus is a Python implementation of the Ensemble Slice Sampling method. Fast & Robust Bayesian Inference, Efficient Markov Chain Monte Carlo (MCMC), Bl

Minas Karamanis 197 Dec 04, 2022
[Link]deep_portfolo - Use Reforcemet earg ad Supervsed learg to Optmze portfolo allocato []

rl_portfolio This Repository uses Reinforcement Learning and Supervised learning to Optimize portfolio allocation. The goal is to make profitable agen

Deepender Singla 165 Dec 02, 2022
Diagnostic tests for linguistic capacities in language models

LM diagnostics This repository contains the diagnostic datasets and experimental code for What BERT is not: Lessons from a new suite of psycholinguist

61 Jan 02, 2023
TumorInsight is a Brain Tumor Detection and Classification model built using RESNET50 architecture.

A Brain Tumor Detection and Classification Model built using RESNET50 architecture. The model is also deployed as a web application using Flask framework.

Pranav Khurana 0 Aug 17, 2021
PyMatting: A Python Library for Alpha Matting

Given an input image and a hand-drawn trimap (top row), alpha matting estimates the alpha channel of a foreground object which can then be composed onto a different background (bottom row).

PyMatting 1.4k Dec 30, 2022
Highway networks implemented in PyTorch.

PyTorch Highway Networks Highway networks implemented in PyTorch. Just the MNIST example from PyTorch hacked to work with Highway layers. Todo Make th

Conner Vercellino 56 Dec 14, 2022
Art Project "Schrödinger's Game of Life"

Repo of the project "Team Creative Quantum AI: Schrödinger's Game of Life" Installation new conda env: conda create --name qcml python=3.8 conda activ

ℍ◮ℕℕ◭ℍ ℝ∈ᛔ∈ℝ 2 Sep 15, 2022
TorchMD-Net provides state-of-the-art graph neural networks and equivariant transformer neural networks potentials for learning molecular potentials

TorchMD-net TorchMD-Net provides state-of-the-art graph neural networks and equivariant transformer neural networks potentials for learning molecular

TorchMD 104 Jan 03, 2023
WTTE-RNN a framework for churn and time to event prediction

WTTE-RNN Weibull Time To Event Recurrent Neural Network A less hacky machine-learning framework for churn- and time to event prediction. Forecasting p

Egil Martinsson 727 Dec 28, 2022