Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

FLAVR is a fast, flow-free frame interpolation method capable of single shot multi-frame prediction

This repository provides some of the code implemented and the data used for the work proposed in "A Cluster-Based Trip Prediction Graph Neural Network Model for Bike Sharing Systems".

Universal Adversarial Examples in Remote Sensing: Methodology and Benchmark

Local-Global Stratified Transformer for Efficient Video Recognition

Metric learning algorithms in Python

An University Project of Quera Web Crawling.

This is the solution for 2nd rank in Kaggle competition: Feedback Prize - Evaluating Student Writing.

PyTorch implementation for SDEdit: Image Synthesis and Editing with Stochastic Differential Equations

A Nim frontend for pytorch, aiming to be mostly auto-generated and internally using ATen.

the official implementation of the paper "Isometric Multi-Shape Matching" (CVPR 2021)

Towards Long-Form Video Understanding

Codes for the AAAI'22 paper "TransZero: Attribute-guided Transformer for Zero-Shot Learning"

ICCV2021 Oral SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy Networks

A pytorch implementation of Paper "Improved Training of Wasserstein GANs"

In real-world applications of machine learning, reliable and safe systems must consider measures of performance beyond standard test set accuracy

TensorFlow 2 implementation of the Yahoo Open-NSFW model

Open source hardware and software platform to build a small scale self driving car.

Pytorch implementation of DeePSiM

Fully convolutional networks for semantic segmentation

Build an Amazon SageMaker Pipeline to Transform Raw Texts to A Knowledge Graph