SOTAVerified

Data Valuation

Data valuation in machine learning tries to determine the worth of data, or data sets, for downstream tasks. Some methods are task-agnostic and consider datasets as a whole, mostly for decision making in data markets. These look at distributional distances between samples. More often, methods look at how individual points affect performance of specific machine learning models. They assign a scalar to each element of a training set which reflects its contribution to the final performance of some model trained on it. Some concepts of value depend on a specific model of interest, others are model-agnostic.

Concepts of the usefulness of a datum or its influence on the outcome of a prediction have a long history in statistics and ML, in particular through the notion of the influence function. However, it has only been recently that rigorous and practical notions of value for data, and in particular data-sets, have appeared in the ML literature, often based on concepts from collaborative game theory, but also from generalization estimates of neural networks, or optimal transport theory, among others.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 119 papers

TitleStatusHype
EcoVal: An Efficient Data Valuation Framework for Machine LearningCode0
One Sample Fits All: Approximating All Probabilistic Values Simultaneously and EfficientlyCode0
Data Distribution ValuationCode0
Efficient Task-Specific Data Valuation for Nearest Neighbor AlgorithmsCode0
SHAPr: An Efficient and Versatile Membership Privacy Risk Metric for Machine Learning—0
Threshold KNN-Shapley: A Linear-Time and Privacy-Friendly Approach to Data Valuation—0
Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective—0
Towards More Efficient Data Valuation in Healthcare Federated Learning using Ensembling—0
Towards Understanding Data Values: Empirical Results on Synthetic Data—0
Proper Dataset Valuation by Pointwise Mutual Information—0
Uncertainty Quantification of Data Shapley via Statistical Inference—0
Unifying and Optimizing Data Values for Selection via Sequential-Decision-Making—0
Validation Free and Replication Robust Volume-based Data Valuation—0
VTruST: Controllable value function based subset selection for Data-Centric Trustworthy AI—0
WaKA: Data Attribution using K-Nearest Neighbors and Membership Privacy Principles—0
Losing is for Cherishing: Data Valuation Based on Machine Unlearning and Shapley Value—0
A Distributional Framework for Data Valuation—0
Towards Understanding the Influence of Training Samples on Explanations—0
An Empirical and Comparative Analysis of Data Valuation with Scalable Algorithms—0
A Note on "Towards Efficient Data Valuation Based on the Shapley Value''—0
A Principled Approach to Data Valuation for Federated Learning—0
Augment & Valuate : A Data Enhancement Pipeline for Data-Centric AI—0
A Unified Framework for Task-Driven Data Quality Management—0
CheckSel: Efficient and Accurate Data-valuation Through Online Checkpoint Selection—0
Cooperative IoT Data Sharing with Heterogeneity of Participants Based on Electricity Retail—0
Data Acquisition for Improving Model Fairness using Reinforcement Learning—0
DAVED: Data Acquisition via Experimental Design for Data Markets—0
Data Overvaluation Attack and Truthful Data Valuation in Federated Learning—0
Data Valuation by Leveraging Global and Local Statistical Information—0
Data Valuation for Medical Imaging Using Shapley Value: Application on A Large-scale Chest X-ray Dataset—0
Data Valuation for Offline Reinforcement Learning—0
Data Valuation for Vertical Federated Learning: A Model-free and Privacy-preserving Method—0
Data value estimation on private gradients—0
Disentangled Structural and Featural Representation for Task-Agnostic Graph Valuation—0
Dissecting Representation Misalignment in Contrastive Learning via Influence Function—0
Efficient Data Shapley for Weighted Nearest Neighbor Algorithms—0
Efficient Data Valuation Approximation in Federated Learning: A Sampling-based Approach—0
Energy-Based Learning for Cooperative Games, with Applications to Valuation Problems in Machine Learning—0
Exploiting the Data Gap: Utilizing Non-ignorable Missingness to Manipulate Model Learning—0
Fairness-Aware Data Valuation for Supervised Learning—0
Fairshare Data Pricing via Data Valuation for Large Language Models—0
Fast-DataShapley: Neural Modeling for Training Data Valuation—0
FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning—0
Fortifying Federated Learning Towards Trustworthiness via Auditable Data Valuation and Verifiable Client Contribution—0
From Fairness to Truthfulness: Rethinking Data Valuation Design—0
Fundamentals of Task-Agnostic Data Valuation—0
Improving Fairness for Data Valuation in Horizontal Federated Learning—0
Incentives in Private Collaborative Machine Learning—0
Investigating Layer Importance in Large Language Models—0
IPProtect: protecting the intellectual property of visual datasets during data valuation—0
Show:102550
← PrevPage 2 of 3Next →

No leaderboard results yet.