Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphs

Official repository for the NeurIPS 2021 paper Get Fooled for the Right Reason: Improving Adversarial Robustness through a Teacher-guided curriculum Learning Approach

Implementation of the federated dual coordinate descent (FedDCD) method.

PESTO: Switching Point based Dynamic and Relative Positional Encoding for Code-Mixed Languages

Code for "Unsupervised Source Separation via Bayesian inference in the latent domain"

Python scripts for performing stereo depth estimation using the MobileStereoNet model in ONNX

Lexical Substitution Framework

pytorch implementation of Attention is all you need

Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression Scheme (NeurIPS2021)

LAMDA: Label Matching Deep Domain Adaptation

PyTorch implementation of the WarpedGANSpace: Finding non-linear RBF paths in GAN latent space (ICCV 2021)

Fast, flexible and fun neural networks.

3rd Place Solution of the Traffic4Cast Core Challenge @ NeurIPS 2021

TransZero++: Cross Attribute-guided Transformer for Zero-Shot Learning

DNA-RECON { Automatic Web Reconnaissance Tool }

[NeurIPS 2021] Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methods

A Novel Plug-in Module for Fine-grained Visual Classification

This repository contains code to run experiments in the paper "Signal Strength and Noise Drive Feature Preference in CNN Image Classifiers."

Source code for our paper "Improving Empathetic Response Generation by Recognizing Emotion Cause in Conversations"

RATCHET is a Medical Transformer for Chest X-ray Diagnosis and Reporting