Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 151–175 of 199 papers

Title	Date	Tasks	Status
Don’t Discard All the Biased Instances: Investigating a Core Assumption in Dataset Bias Mitigation Techniques	Nov 1, 2021	AllBias Detection	CodeCode Available
Detection of Puffery on the English Wikipedia	Nov 1, 2021	Bias DetectionInformation Retrieval	CodeCode Available
Detecting Gender Bias in Transformer-based Models: A Case Study on BERT	Oct 15, 2021	Bias DetectionGender Bias Detection	—Unverified
Deep Learning for Bias Detection: From Inception to Deployment	Oct 12, 2021	Bias DetectionDeep Learning	—Unverified
Second Order WinoBias (SoWinoBias) Test Set for Latent Gender Bias Detection in Coreference Resolution	Sep 28, 2021	Bias Detectioncoreference-resolution	CodeCode Available
Towards Automatic Bias Detection in Knowledge Graphs	Sep 19, 2021	Bias DetectionFairness	CodeCode Available
IFBiD: Inference-Free Bias Detection	Sep 9, 2021	Bias Detection	CodeCode Available
Fairness via AI: Bias Reduction in Medical Information	Sep 6, 2021	Bias DetectionFairness	—Unverified
Don't Discard All the Biased Instances: Investigating a Core Assumption in Dataset Bias Mitigation Techniques	Sep 1, 2021	AllBias Detection	CodeCode Available
Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2021): Workshop and Shared Task Report	Aug 17, 2021	Bias DetectionLearning Word Embeddings	—Unverified
Sexism in the Judiciary: The Importance of Bias Definition in NLP and In Our Courts	Aug 1, 2021	Bias Detection	—Unverified
Fine-grained Classification of Political Bias in German News: A Data Set and Initial Experiments	Aug 1, 2021	ArticlesBias Detection	CodeCode Available
Inferring bias and uncertainty in camera calibration	Jul 28, 2021	Bias DetectionCamera Calibration	—Unverified
Pseudo-labelling Enhanced Media Bias Detection	Jul 16, 2021	Bias DetectionData Augmentation	—Unverified
Sexism in the Judiciary	Jun 29, 2021	Bias Detection	—Unverified
iReason: Multimodal Commonsense Reasoning using Videos and Natural Language with Interpretability	Jun 25, 2021	Bias DetectionQuestion Answering	—Unverified
MBIC -- A Media Bias Annotation Dataset Including Annotator Characteristics	May 20, 2021	ArticlesBias Detection	—Unverified
Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema	Apr 16, 2021	Artifact DetectionBias Detection	—Unverified
Detecting Cross-Geographic Biases in Toxicity Modeling on Social Media	Apr 14, 2021	Bias Detection	—Unverified
fairmodels: A Flexible Tool For Bias Detection, Visualization, And Mitigation	Apr 1, 2021	Bias DetectionFairness	CodeCode Available
A Survey on Predicting the Factuality and the Bias of News Media	Mar 16, 2021	ArticlesBias Detection	—Unverified
BENN: Bias Estimation Using Deep Neural Network	Dec 23, 2020	Bias Detection	—Unverified
Investigating Bias in Image Classification using Model Explanations	Dec 10, 2020	Bias DetectionClassification	—Unverified
Context in Informational Bias Detection	Dec 3, 2020	ArticlesBias Detection	CodeCode Available
Detecting Media Bias in News Articles using Gaussian Bias Distributions	Oct 20, 2020	ArticlesBias Detection	CodeCode Available

Show:10 25 50

← PrevPage 7 of 8Next →

All datasets StereoSet rt-inod-bias ICAT LLM bias PlantVillage_8px Wiki Neutrality Corpus

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	GPT-2 (small)	ICAT Score	72.97	—	Unverified
2	XLNet (large)	ICAT Score	72.03	—	Unverified
3	GPT-2 (medium)	ICAT Score	71.73	—	Unverified
4	BERT (base)	ICAT Score	71.21	—	Unverified
5	GPT-2 (large)	ICAT Score	70.54	—	Unverified
6	BERT (large)	ICAT Score	69.89	—	Unverified
7	RoBERTa (base)	ICAT Score	67.5	—	Unverified
8	GAL 120B	ICAT Score	65.6	—	Unverified
9	XLNet (base)	ICAT Score	62.1	—	Unverified
10	GPT-3 (text-davinci-002)	ICAT Score	60.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GPT-4	Best-of	0.5	—	Unverified
2	Baseline	Best-of	0.41	—	Unverified
3	Gemma	Best-of	0.41	—	Unverified
4	Mistral	Best-of	0.36	—	Unverified
5	Llama2	Best-of	0.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BAD	ICAT Score	23.44	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RandomForest_default_hyperparameters	Accuracy (%)	49	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RoBERTa+ALBERT	F1	70.4	—	Unverified