Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

LIMEcraft: Handcrafted superpixel selectionand inspection for Visual eXplanations

A tensorflow implementation of an HMM layer

Code & Experiments for "LILA: Language-Informed Latent Actions" to be presented at the Conference on Robot Learning (CoRL) 2021.

《Rethinking Sptil Dimensions of Vision Trnsformers》(2021)

implementation of the paper "MarginGAN: Adversarial Training in Semi-Supervised Learning"

Code for Massive-scale Decoding for Text Generation using Lattices

Backend code to use MCPI's python API to make infinite worlds with custom generation

This repository focus on Image Captioning & Video Captioning & Seq-to-Seq Learning & NLP

Simple STAC Catalogs discovery tool.

A production-ready, scalable Indexer for the Jina neural search framework, based on HNSW and PSQL

Denoising images with Fourier Ring Correlation loss

CZU-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and 10 wearable inertial sensors

Tool which allow you to detect and translate text.

Office source code of paper UniFuse: Unidirectional Fusion for 360$^\circ$ Panorama Depth Estimation

Implementation of the GVP-Transformer, which was used in the paper "Learning inverse folding from millions of predicted structures" for de novo protein design alongside Alphafold2

Awesome AI Learning with +100 AI Cheat-Sheets, Free online Books, Top Courses, Best Videos and Lectures, Papers, Tutorials, +99 Researchers, Premium Websites, +121 Datasets, Conferences, Frameworks, Tools

Video-Captioning - A machine Learning project to generate captions for video frames indicating the relationship between the objects in the video

Software that can generate photos from paintings, turn horses into zebras, perform style transfer, and more.

Face Synthetics dataset is a collection of diverse synthetic face images with ground truth labels.

Pytorch implementation of FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks