SOTAVerified

Data Valuation

Data valuation in machine learning tries to determine the worth of data, or data sets, for downstream tasks. Some methods are task-agnostic and consider datasets as a whole, mostly for decision making in data markets. These look at distributional distances between samples. More often, methods look at how individual points affect performance of specific machine learning models. They assign a scalar to each element of a training set which reflects its contribution to the final performance of some model trained on it. Some concepts of value depend on a specific model of interest, others are model-agnostic.

Concepts of the usefulness of a datum or its influence on the outcome of a prediction have a long history in statistics and ML, in particular through the notion of the influence function. However, it has only been recently that rigorous and practical notions of value for data, and in particular data-sets, have appeared in the ML literature, often based on concepts from collaborative game theory, but also from generalization estimates of neural networks, or optimal transport theory, among others.

Papers

Showing 2650 of 119 papers

TitleStatusHype
Efficient Data Shapley for Weighted Nearest Neighbor Algorithms0
Data Valuation by Leveraging Global and Local Statistical Information0
Data Valuation for Medical Imaging Using Shapley Value: Application on A Large-scale Chest X-ray Dataset0
Data Valuation for Offline Reinforcement Learning0
Data Valuation for Vertical Federated Learning: A Model-free and Privacy-preserving Method0
DAVED: Data Acquisition via Experimental Design for Data Markets0
Investigating Layer Importance in Large Language Models0
Is Data Valuation Learnable and Interpretable?0
Data Acquisition for Improving Model Fairness using Reinforcement Learning0
Fundamentals of Task-Agnostic Data Valuation0
Data value estimation on private gradients0
A Note on "Towards Efficient Data Valuation Based on the Shapley Value''0
Disentangled Structural and Featural Representation for Task-Agnostic Graph Valuation0
Improving Fairness for Data Valuation in Horizontal Federated Learning0
Dissecting Representation Misalignment in Contrastive Learning via Influence Function0
FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning0
Cooperative IoT Data Sharing with Heterogeneity of Participants Based on Electricity Retail0
Efficient Data Valuation Approximation in Federated Learning: A Sampling-based Approach0
Augment & Valuate : A Data Enhancement Pipeline for Data-Centric AI0
Fortifying Federated Learning Towards Trustworthiness via Auditable Data Valuation and Verifiable Client Contribution0
Exploiting the Data Gap: Utilizing Non-ignorable Missingness to Manipulate Model Learning0
Data Overvaluation Attack and Truthful Data Valuation in Federated Learning0
Fairness-Aware Data Valuation for Supervised Learning0
A Unified Framework for Task-Driven Data Quality Management0
Fairshare Data Pricing via Data Valuation for Large Language Models0
Show:102550
← PrevPage 2 of 5Next →

No leaderboard results yet.