SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 76–100 of 199 papers

TitleStatusHype
OpenBias: Open-set Bias Detection in Text-to-Image Generative ModelsCode1
The Impact of Unstated Norms in Bias Analysis of Language Models—0
Implications of the AI Act for Non-Discrimination Law and Algorithmic Fairness—0
ChatGPT v.s. Media Bias: A Comparative Study of GPT-3.5 and Fine-tuned Language Models—0
DeNetDM: Debiasing by Network Depth ModulationCode0
RuBia: A Russian Language Bias Detection DatasetCode0
MAGPIE: Multi-Task Media-Bias Analysis Generalization for Pre-Trained Identification of ExpressionsCode0
Decoding News Narratives: A Critical Analysis of Large Language Models in Framing Detection—0
IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias IndicatorsCode0
New Job, New Gender? Measuring the Social Bias in Image Generation ModelsCode1
The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media BiasCode0
Multilingual Bias Detection and Mitigation for Indian Languages—0
Large Language Model (LLM) Bias Index -- LLMBI—0
Extending Variability-Aware Model Selection with Bias Detection in Machine Learning Projects—0
Current Topological and Machine Learning Applications for Bias Detection in Text—0
Subtle Misogyny Detection and Mitigation: An Expert-Annotated Dataset—0
Unmasking Bias in AI: A Systematic Review of Bias Detection and Mitigation Strategies in Electronic Health Record-based Models—0
Target-Aware Contextual Political Bias Detection in News—0
Unlocking Bias Detection: Leveraging Transformer-Based Models for Content Analysis—0
Investigating Subtler Biases in LLMs: Ageism, Beauty, Institutional, and Nationality Bias in Generative ModelsCode0
Unsupervised Bias Detection in College Student Newspapers—0
LUCID-GAN: Conditional Generative Models to Locate UnfairnessCode0
Auditing Predictive Models for Intersectional Biases—0
The Hidden Language of Diffusion ModelsCode1
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark DatasetsCode1
Show:102550
← PrevPage 4 of 8Next →
All datasetsStereoSetrt-inod-biasICAT LLM biasPlantVillage_8pxWiki Neutrality Corpus

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97—Unverified
2XLNet (large)ICAT Score72.03—Unverified
3GPT-2 (medium)ICAT Score71.73—Unverified
4BERT (base)ICAT Score71.21—Unverified
5GPT-2 (large)ICAT Score70.54—Unverified
6BERT (large)ICAT Score69.89—Unverified
7RoBERTa (base)ICAT Score67.5—Unverified
8GAL 120BICAT Score65.6—Unverified
9XLNet (base)ICAT Score62.1—Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5—Unverified
2GemmaBest-of0.41—Unverified
3BaselineBest-of0.41—Unverified
4MistralBest-of0.36—Unverified
5Llama2Best-of0.34—Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44—Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4—Unverified