SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 176–199 of 199 papers

TitleStatusHype
Decoding News Bias: Multi Bias Detection in News Articles—0
Decoding News Narratives: A Critical Analysis of Large Language Models in Framing Detection—0
Deep Learning for Bias Detection: From Inception to Deployment—0
Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Play—0
Designing Tools for Semi-Automated Detection of Machine Learning Biases: An Interview Study—0
Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema—0
Detecting Gender Bias in Transformer-based Models: A Case Study on BERT—0
Detecting Linguistic Bias in Government Documents Using Large language Models—0
The Impact of Unstated Norms in Bias Analysis of Language Models—0
Detecting Political Bias in News Articles Using Headline Attention—0
Robots Enact Malignant Stereotypes—0
Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarks—0
Unsupervised Bias Detection in College Student Newspapers—0
Sample Complexity of Bias Detection with Subsampled Point-to-Subspace Distances—0
DocNet: Semantic Structure in Inductive Bias Detection Models—0
Towards Understanding and Quantifying Uncertainty for Text-to-Image Generation—0
Seeing Like an AI: How LLMs Apply (and Misapply) Wikipedia Neutrality Norms—0
Efficient Fairness Testing in Large Language Models: Prioritizing Metamorphic Relations for Bias Detection—0
Efficient Gender Debiasing of Pre-trained Indic Language Models—0
Enhancing Bias Detection in Political News Using Pragmatic Presupposition—0
Mitigating the Risk of Health Inequity Exacerbated by Large Language Models—0
Auditing Predictive Models for Intersectional Biases—0
Epistemological Bias As a Means for the Automated Detection of Injustices in Text—0
Evaluating AI fairness in credit scoring with the BRIO tool—0
Show:102550
← PrevPage 8 of 8Next →
All datasetsStereoSetrt-inod-biasICAT LLM biasPlantVillage_8pxWiki Neutrality Corpus

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97—Unverified
2XLNet (large)ICAT Score72.03—Unverified
3GPT-2 (medium)ICAT Score71.73—Unverified
4BERT (base)ICAT Score71.21—Unverified
5GPT-2 (large)ICAT Score70.54—Unverified
6BERT (large)ICAT Score69.89—Unverified
7RoBERTa (base)ICAT Score67.5—Unverified
8GAL 120BICAT Score65.6—Unverified
9XLNet (base)ICAT Score62.1—Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5—Unverified
2BaselineBest-of0.41—Unverified
3GemmaBest-of0.41—Unverified
4MistralBest-of0.36—Unverified
5Llama2Best-of0.34—Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44—Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4—Unverified