SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 199 papers

TitleStatusHype
Decoding News Narratives: A Critical Analysis of Large Language Models in Framing Detection—0
IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias IndicatorsCode0
The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media BiasCode0
Multilingual Bias Detection and Mitigation for Indian Languages—0
Large Language Model (LLM) Bias Index -- LLMBI—0
Extending Variability-Aware Model Selection with Bias Detection in Machine Learning Projects—0
Current Topological and Machine Learning Applications for Bias Detection in Text—0
Subtle Misogyny Detection and Mitigation: An Expert-Annotated Dataset—0
Unmasking Bias in AI: A Systematic Review of Bias Detection and Mitigation Strategies in Electronic Health Record-based Models—0
Target-Aware Contextual Political Bias Detection in News—0
Unlocking Bias Detection: Leveraging Transformer-Based Models for Content Analysis—0
Investigating Subtler Biases in LLMs: Ageism, Beauty, Institutional, and Nationality Bias in Generative ModelsCode0
Unsupervised Bias Detection in College Student Newspapers—0
LUCID-GAN: Conditional Generative Models to Locate UnfairnessCode0
Auditing Predictive Models for Intersectional Biases—0
Trade-Offs Between Fairness and Privacy in Language ModelingCode0
Language-Agnostic Bias Detection in Language Models with Bias ProbingCode0
Bipol: A Novel Multi-Axes Bias Evaluation Metric with Explainability for NLPCode0
Disentangling Structure and Style: Political Bias Detection in News by Inducing Document HierarchyCode0
Adding Instructions during Pretraining: Effective Way of Controlling Toxicity in Language Models—0
Bipol: Multi-axes Evaluation of Bias with Explainability in Benchmark DatasetsCode0
Auditing Algorithmic Fairness in Machine Learning for Health with Severity-Based LOGAN—0
Mind Your Bias: A Critical Review of Bias Detection Methods for Contextual Language ModelsCode0
Exploiting Transformer-based Multitask Learning for the Detection of Media Bias in News Articles—0
A Keyword Based Approach to Understanding the Overpenalization of Marginalized Groups by English Marginal Abuse Models on Twitter—0
Efficient Gender Debiasing of Pre-trained Indic Language Models—0
A Unified Comparison of User Modeling Techniques for Predicting Data Interaction and Detecting Exploration BiasCode0
Robots Enact Malignant Stereotypes—0
MRCLens: an MRC Dataset Bias Detection Toolkit—0
A methodology to characterize bias and harmful stereotypes in natural language processing in Latin AmericaCode0
Incorporating Subjectivity into Gendered Ambiguous Pronoun (GAP) Resolution using Style Transfer—0
HeteroCorpus: A Corpus for Heteronormative Language DetectionCode0
Personalized Detection of Cognitive Biases in Actions of Users from Their Logs: Anchoring and Recency Biases—0
Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Models—0
Uncovering bias in the PlantVillage datasetCode0
Beyond Explanation: A Case for Exploratory Text Visualizations of Non-Aggregated, Annotated Datasets—0
A Domain-adaptive Pre-training Approach for Language Bias Detection in NewsCode0
How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contextsCode0
Constructive Interpretability with CoLabel: Corroborative Integration, Complementary Features, and Collaborative Learning—0
Towards Detecting Political Bias in Hindi News Articles—0
A Meta Survey of Quality Evaluation Criteria in Explanation Methods—0
Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarks—0
Modeling Multi-level Context for Informational Bias Detection by Contrastive Learning and Sentential Graph Network—0
An Interdisciplinary Approach for the Automated Detection and Visualization of Media Bias in News Articles—0
Forward Composition Propagation for Explainable Neural ReasoningCode0
Quantifying Gender Biases Towards Politicians on RedditCode0
Towards A Reliable Ground-Truth For Biased Language Detection—0
Sparse Interventions in Language Models with Differentiable Masking—0
Anatomizing Bias in Facial Analysis—0
MRCLens: an MRC Dataset Bias Detection Toolkit—0
Show:102550
← PrevPage 3 of 4Next →
All datasetsStereoSetrt-inod-biasICAT LLM biasPlantVillage_8pxWiki Neutrality Corpus

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97—Unverified
2XLNet (large)ICAT Score72.03—Unverified
3GPT-2 (medium)ICAT Score71.73—Unverified
4BERT (base)ICAT Score71.21—Unverified
5GPT-2 (large)ICAT Score70.54—Unverified
6BERT (large)ICAT Score69.89—Unverified
7RoBERTa (base)ICAT Score67.5—Unverified
8GAL 120BICAT Score65.6—Unverified
9XLNet (base)ICAT Score62.1—Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5—Unverified
2BaselineBest-of0.41—Unverified
3GemmaBest-of0.41—Unverified
4MistralBest-of0.36—Unverified
5Llama2Best-of0.34—Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44—Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4—Unverified