The Re-Label Method For Data-Centric Machine Learning
2023-02-09Code Available0· sign in to hype
Tong Guo
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/guotong1988/Automatic-Label-Error-CorrectionOfficialpytorch★ 5
Abstract
In industry deep learning application, our manually labeled data has a certain number of noisy data. To solve this problem and achieve more than 90 score in dev dataset, we present a simple method to find the noisy data and re-label the noisy data by human, given the model predictions as references in human labeling. In this paper, we illustrate our idea for a broad set of deep learning tasks, includes classification, sequence tagging, object detection, sequence generation, click-through rate prediction. The dev dataset evaluation results and human evaluation results verify our idea.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| TREC-6 | github.com/guotong1988/Automatic-Label-Error-Correction | Accuracy | 99 | — | Unverified |