SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 76–100 of 199 papers

TitleStatusHype
Exploiting Transformer-based Multitask Learning for the Detection of Media Bias in News Articles—0
Extending Variability-Aware Model Selection with Bias Detection in Machine Learning Projects—0
Fair Is Better than Sensational: Man Is to Doctor as Woman Is to Doctor—0
Fairness via AI: Bias Reduction in Medical Information—0
FairT2I: Mitigating Social Bias in Text-to-Image Generation via Large Language Model-Assisted Detection and Attribute Rebalancing—0
Fine-Grained Bias Detection in LLM: Enhancing detection mechanisms for nuanced biases—0
Implications of the AI Act for Non-Discrimination Law and Algorithmic Fairness—0
Improved Models for Media Bias Detection and Subcategorization—0
Incorporating Subjectivity into Gendered Ambiguous Pronoun (GAP) Resolution using Style Transfer—0
Inferring bias and uncertainty in camera calibration—0
InsideBias: Measuring Bias in Deep Networks and Application to Face Gender Biometrics—0
Investigating Bias in Image Classification using Model Explanations—0
iReason: Multimodal Commonsense Reasoning using Videos and Natural Language with Interpretability—0
Large Language Model (LLM) Bias Index -- LLMBI—0
Large-scale news entity sentiment analysis—0
LLMs can be easily Confused by Instructional Distractions—0
Split and Expand: An inference-time improvement for Weakly Supervised Cell Instance Segmentation—0
MBIC -- A Media Bias Annotation Dataset Including Annotator Characteristics—0
MediaSpin: Exploring Media Bias Through Fine-Grained Analysis of News Headlines—0
Modeling Multi-level Context for Informational Bias Detection by Contrastive Learning and Sentential Graph Network—0
MRCLens: an MRC Dataset Bias Detection Toolkit—0
MRCLens: an MRC Dataset Bias Detection Toolkit—0
Multilingual Bias Detection and Mitigation for Indian Languages—0
Neutralizing the Narrative: AI-Powered Debiasing of Online News Articles—0
On the Mutual Influence of Gender and Occupation in LLM Representations—0
Show:102550
← PrevPage 4 of 8Next →
All datasetsStereoSetrt-inod-biasICAT LLM biasPlantVillage_8pxWiki Neutrality Corpus

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97—Unverified
2XLNet (large)ICAT Score72.03—Unverified
3GPT-2 (medium)ICAT Score71.73—Unverified
4BERT (base)ICAT Score71.21—Unverified
5GPT-2 (large)ICAT Score70.54—Unverified
6BERT (large)ICAT Score69.89—Unverified
7RoBERTa (base)ICAT Score67.5—Unverified
8GAL 120BICAT Score65.6—Unverified
9XLNet (base)ICAT Score62.1—Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5—Unverified
2GemmaBest-of0.41—Unverified
3BaselineBest-of0.41—Unverified
4MistralBest-of0.36—Unverified
5Llama2Best-of0.34—Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44—Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4—Unverified