Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 151–175 of 199 papers

Title	Date	Tasks	Status	Hype
IFBiD: Inference-Free Bias Detection	Sep 9, 2021	Bias Detection	CodeCode Available	0
Amazon SageMaker Clarify: Machine Learning Bias Detection and Explainability in the Cloud	Sep 7, 2021	Bias DetectionBIG-bench Machine Learning	CodeCode Available	1
Fairness via AI: Bias Reduction in Medical Information	Sep 6, 2021	Bias DetectionFairness	—Unverified	0
Don't Discard All the Biased Instances: Investigating a Core Assumption in Dataset Bias Mitigation Techniques	Sep 1, 2021	AllBias Detection	CodeCode Available	0
Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2021): Workshop and Shared Task Report	Aug 17, 2021	Bias DetectionLearning Word Embeddings	—Unverified	0
Sexism in the Judiciary: The Importance of Bias Definition in NLP and In Our Courts	Aug 1, 2021	Bias Detection	—Unverified	0
Fine-grained Classification of Political Bias in German News: A Data Set and Initial Experiments	Aug 1, 2021	ArticlesBias Detection	CodeCode Available	0
Inferring bias and uncertainty in camera calibration	Jul 28, 2021	Bias DetectionCamera Calibration	—Unverified	0
Pseudo-labelling Enhanced Media Bias Detection	Jul 16, 2021	Bias DetectionData Augmentation	—Unverified	0
Sexism in the Judiciary	Jun 29, 2021	Bias Detection	—Unverified	0
iReason: Multimodal Commonsense Reasoning using Videos and Natural Language with Interpretability	Jun 25, 2021	Bias DetectionQuestion Answering	—Unverified	0
Benchmarking Bias Mitigation Algorithms in Representation Learning through Fairness Metrics	Jun 8, 2021	Age And Gender ClassificationBenchmarking	CodeCode Available	1
MBIC -- A Media Bias Annotation Dataset Including Annotator Characteristics	May 20, 2021	ArticlesBias Detection	—Unverified	0
Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema	Apr 16, 2021	Artifact DetectionBias Detection	—Unverified	0
Exploring Visual Engagement Signals for Representation Learning	Apr 15, 2021	Bias DetectionEmotion Recognition	CodeCode Available	1
Detecting Cross-Geographic Biases in Toxicity Modeling on Social Media	Apr 14, 2021	Bias Detection	—Unverified	0
fairmodels: A Flexible Tool For Bias Detection, Visualization, And Mitigation	Apr 1, 2021	Bias DetectionFairness	CodeCode Available	0
A Survey on Predicting the Factuality and the Bias of News Media	Mar 16, 2021	ArticlesBias Detection	—Unverified	0
BENN: Bias Estimation Using Deep Neural Network	Dec 23, 2020	Bias Detection	—Unverified	0
Investigating Bias in Image Classification using Model Explanations	Dec 10, 2020	Bias DetectionClassification	—Unverified	0
Context in Informational Bias Detection	Dec 3, 2020	ArticlesBias Detection	CodeCode Available	0
Detecting Media Bias in News Articles using Gaussian Bias Distributions	Oct 20, 2020	ArticlesBias Detection	CodeCode Available	0
LOGAN: Local Group Bias Detection by Clustering	Oct 6, 2020	Bias DetectionBIG-bench Machine Learning	CodeCode Available	0
Corpora Evaluation and System Bias Detection in Multi-document Summarization	Oct 5, 2020	Bias DetectionDocument Summarization	CodeCode Available	0
Split and Expand: An inference-time improvement for Weakly Supervised Cell Instance Segmentation	Jul 21, 2020	Bias DetectionInstance Segmentation	—Unverified	0

Show:10 25 50

← PrevPage 7 of 8Next →

All datasets StereoSet rt-inod-bias ICAT LLM bias PlantVillage_8px Wiki Neutrality Corpus

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	GPT-2 (small)	ICAT Score	72.97	—	Unverified
2	XLNet (large)	ICAT Score	72.03	—	Unverified
3	GPT-2 (medium)	ICAT Score	71.73	—	Unverified
4	BERT (base)	ICAT Score	71.21	—	Unverified
5	GPT-2 (large)	ICAT Score	70.54	—	Unverified
6	BERT (large)	ICAT Score	69.89	—	Unverified
7	RoBERTa (base)	ICAT Score	67.5	—	Unverified
8	GAL 120B	ICAT Score	65.6	—	Unverified
9	XLNet (base)	ICAT Score	62.1	—	Unverified
10	GPT-3 (text-davinci-002)	ICAT Score	60.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	Best-of	0.5	—	Unverified
2	Baseline	Best-of	0.41	—	Unverified
3	Gemma	Best-of	0.41	—	Unverified
4	Mistral	Best-of	0.36	—	Unverified
5	Llama2	Best-of	0.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BAD	ICAT Score	23.44	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RandomForest_default_hyperparameters	Accuracy (%)	49	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RoBERTa+ALBERT	F1	70.4	—	Unverified