SOTAVerified

Data Valuation

Data valuation in machine learning tries to determine the worth of data, or data sets, for downstream tasks. Some methods are task-agnostic and consider datasets as a whole, mostly for decision making in data markets. These look at distributional distances between samples. More often, methods look at how individual points affect performance of specific machine learning models. They assign a scalar to each element of a training set which reflects its contribution to the final performance of some model trained on it. Some concepts of value depend on a specific model of interest, others are model-agnostic.

Concepts of the usefulness of a datum or its influence on the outcome of a prediction have a long history in statistics and ML, in particular through the notion of the influence function. However, it has only been recently that rigorous and practical notions of value for data, and in particular data-sets, have appeared in the ML literature, often based on concepts from collaborative game theory, but also from generalization estimates of neural networks, or optimal transport theory, among others.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 119 papers

TitleStatusHype
shapiq: Shapley Interactions for Machine LearningCode4
What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence FunctionsCode2
Redefining Contributions: Shapley-Driven Federated LearningCode1
Data Valuation and Detections in Federated LearningCode1
Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine LearningCode1
The Shapley Value in Machine LearningCode1
Interpretable Machine Learning for TabPFNCode1
Data-OOB: Out-of-bag Estimate as a Simple and Efficient Data ValueCode1
OpenDataVal: a Unified Benchmark for Data ValuationCode1
Data Shapley: Equitable Valuation of Data for Machine LearningCode1
Data Valuation Without Training of a ModelCode1
LAVA: Data Valuation without Pre-Specified Learning AlgorithmsCode1
ALinFiK: Learning to Approximate Linearized Future Influence Kernel for Scalable Third-Party LLM Data ValuationCode1
Data Banzhaf: A Robust Data Valuation Framework for Machine LearningCode1
CheckSel: Efficient and Accurate Data-valuation Through Online Checkpoint Selection—0
An Empirical and Comparative Analysis of Data Valuation with Scalable Algorithms—0
Accelerated Shapley Value Approximation for Data Evaluation—0
LiveVal: Time-aware Data Valuation via Adaptive Reference Points—0
LLM-Aided Customizable Profiling of Code Data Based On Programming Language Concepts—0
Load Data Valuation in Multi-Energy Systems: An End-to-End Approach—0
Energy-Based Learning for Cooperative Games, with Applications to Valuation Problems in Machine Learning—0
A Principled Approach to Data Valuation for Federated Learning—0
Towards Understanding the Influence of Training Samples on Explanations—0
Improving Cooperative Game Theory-based Data Valuation via Data Utility Learning—0
IPProtect: protecting the intellectual property of visual datasets during data valuation—0
Efficient Data Shapley for Weighted Nearest Neighbor Algorithms—0
Data Valuation by Leveraging Global and Local Statistical Information—0
Data Valuation for Medical Imaging Using Shapley Value: Application on A Large-scale Chest X-ray Dataset—0
Data Valuation for Offline Reinforcement Learning—0
Data Valuation for Vertical Federated Learning: A Model-free and Privacy-preserving Method—0
DAVED: Data Acquisition via Experimental Design for Data Markets—0
Investigating Layer Importance in Large Language Models—0
Is Data Valuation Learnable and Interpretable?—0
Data Acquisition for Improving Model Fairness using Reinforcement Learning—0
Fundamentals of Task-Agnostic Data Valuation—0
Data value estimation on private gradients—0
A Note on "Towards Efficient Data Valuation Based on the Shapley Value''—0
Disentangled Structural and Featural Representation for Task-Agnostic Graph Valuation—0
Improving Fairness for Data Valuation in Horizontal Federated Learning—0
Dissecting Representation Misalignment in Contrastive Learning via Influence Function—0
FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning—0
Cooperative IoT Data Sharing with Heterogeneity of Participants Based on Electricity Retail—0
Efficient Data Valuation Approximation in Federated Learning: A Sampling-based Approach—0
Augment & Valuate : A Data Enhancement Pipeline for Data-Centric AI—0
Fortifying Federated Learning Towards Trustworthiness via Auditable Data Valuation and Verifiable Client Contribution—0
Exploiting the Data Gap: Utilizing Non-ignorable Missingness to Manipulate Model Learning—0
Data Overvaluation Attack and Truthful Data Valuation in Federated Learning—0
Fairness-Aware Data Valuation for Supervised Learning—0
A Unified Framework for Task-Driven Data Quality Management—0
Fairshare Data Pricing via Data Valuation for Large Language Models—0
Show:102550
← PrevPage 1 of 3Next →

No leaderboard results yet.