SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–25 of 199 papers

TitleStatusHype
How Neural Networks Organize Concepts: Introducing Concept Trajectory Analysis for Deep Learning InterpretabilityCode0
Cascading Adversarial Bias from Injection to Distillation in Language Models—0
Can we Debias Social Stereotypes in AI-Generated Images? Examining Text-to-Image Outputs and User Perceptions—0
Any Large Language Model Can Be a Reliable Judge: Debiasing with a Reasoning-based Bias Detector—0
BiasLab: Toward Explainable Political Bias Detection with Dual-Axis Annotations and Rationale Indicators—0
To Bias or Not to Bias: Detecting bias in News with bias-detectorCode0
Can Global XAI Methods Reveal Injected Bias in LLMs? SHAP vs Rule Extraction vs RuleSHAPCode0
Efficient Fairness Testing in Large Language Models: Prioritizing Metamorphic Relations for Bias Detection—0
Explainable AI in Spatial AnalysisCode2
BiasGuard: A Reasoning-enhanced Bias Detection Tool For Large Language Models—0
Toward Holistic Evaluation of Recommender Systems Powered by Generative Models—0
Neutralizing the Narrative: AI-Powered Debiasing of Online News Articles—0
STOOD-X methodology: using statistical nonparametric test for OOD Detection Large-Scale datasets enhanced with explainability—0
On the Mutual Influence of Gender and Occupation in LLM Representations—0
Fine-Grained Bias Detection in LLM: Enhancing detection mechanisms for nuanced biases—0
Cognitive Bias Detection Using Advanced Prompt Engineering—0
Visual Reasoning Evaluation of Grok, Deepseek Janus, Gemini, Qwen, Mistral, and ChatGPT—0
Robust Bias Detection in MLMs and its Application to Human Trait RatingsCode0
Detecting Linguistic Bias in Government Documents Using Large language Models—0
Towards Equitable AI: Detecting Bias in Using Large Language Models for Marketing—0
BiaSWE: An Expert Annotated Dataset for Misogyny Detection in Swedish—0
FairT2I: Mitigating Social Bias in Text-to-Image Generation via Large Language Model-Assisted Detection and Attribute Rebalancing—0
LLMs can be easily Confused by Instructional Distractions—0
Sample Complexity of Bias Detection with Subsampled Point-to-Subspace Distances—0
Bias Detection via Maximum Subgroup Discrepancy—0
Show:102550
← PrevPage 1 of 8Next →
All datasetsStereoSetrt-inod-biasICAT LLM biasPlantVillage_8pxWiki Neutrality Corpus

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97—Unverified
2XLNet (large)ICAT Score72.03—Unverified
3GPT-2 (medium)ICAT Score71.73—Unverified
4BERT (base)ICAT Score71.21—Unverified
5GPT-2 (large)ICAT Score70.54—Unverified
6BERT (large)ICAT Score69.89—Unverified
7RoBERTa (base)ICAT Score67.5—Unverified
8GAL 120BICAT Score65.6—Unverified
9XLNet (base)ICAT Score62.1—Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5—Unverified
2GemmaBest-of0.41—Unverified
3BaselineBest-of0.41—Unverified
4MistralBest-of0.36—Unverified
5Llama2Best-of0.34—Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44—Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4—Unverified