SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 199 papers

TitleStatusHype
Galactica: A Large Language Model for ScienceCode4
Explainable AI in Spatial AnalysisCode2
MT-LENS: An all-in-one Toolkit for Better Machine Translation EvaluationCode1
Counterfactual Token Generation in Large Language ModelsCode1
Explainable AI for computational pathology identifies model limitations and tissue biomarkersCode1
SynthesizRR: Generating Diverse Datasets with Retrieval AugmentationCode1
Benchmarking Llama2, Mistral, Gemma and GPT for Factuality, Toxicity, Bias and Propensity for HallucinationsCode1
OpenBias: Open-set Bias Detection in Text-to-Image Generative ModelsCode1
New Job, New Gender? Measuring the Social Bias in Image Generation ModelsCode1
The Hidden Language of Diffusion ModelsCode1
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark DatasetsCode1
BiasAsker: Measuring the Bias in Conversational AI SystemCode1
BAD: BiAs Detection for Large Language Models in the context of candidate screeningCode1
Introducing MBIB -- the first Media Bias Identification Benchmark Task and Dataset CollectionCode1
Neural Media Bias Detection Using Distant Supervision With BABE -- Bias Annotations By ExpertsCode1
Learning to Split for Automatic Bias DetectionCode1
Entropy-based Attention Regularization Frees Unintended Bias Mitigation from ListsCode1
Debiased Visual Question Answering from Feature and Sample PerspectivesCode1
Neural Media Bias Detection Using Distant Supervision With BABE - Bias Annotations By ExpertsCode1
Amazon SageMaker Clarify: Machine Learning Bias Detection and Explainability in the CloudCode1
Benchmarking Bias Mitigation Algorithms in Representation Learning through Fairness MetricsCode1
Exploring Visual Engagement Signals for Representation LearningCode1
Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like BiasesCode1
Towards explainable classifiers using the counterfactual approach -- global explanations for discovering bias in dataCode1
StereoSet: Measuring stereotypical bias in pretrained language modelsCode1
How Neural Networks Organize Concepts: Introducing Concept Trajectory Analysis for Deep Learning InterpretabilityCode0
Cascading Adversarial Bias from Injection to Distillation in Language Models—0
Can we Debias Social Stereotypes in AI-Generated Images? Examining Text-to-Image Outputs and User Perceptions—0
Any Large Language Model Can Be a Reliable Judge: Debiasing with a Reasoning-based Bias Detector—0
BiasLab: Toward Explainable Political Bias Detection with Dual-Axis Annotations and Rationale Indicators—0
To Bias or Not to Bias: Detecting bias in News with bias-detectorCode0
Can Global XAI Methods Reveal Injected Bias in LLMs? SHAP vs Rule Extraction vs RuleSHAPCode0
Efficient Fairness Testing in Large Language Models: Prioritizing Metamorphic Relations for Bias Detection—0
BiasGuard: A Reasoning-enhanced Bias Detection Tool For Large Language Models—0
Toward Holistic Evaluation of Recommender Systems Powered by Generative Models—0
Neutralizing the Narrative: AI-Powered Debiasing of Online News Articles—0
STOOD-X methodology: using statistical nonparametric test for OOD Detection Large-Scale datasets enhanced with explainability—0
On the Mutual Influence of Gender and Occupation in LLM Representations—0
Fine-Grained Bias Detection in LLM: Enhancing detection mechanisms for nuanced biases—0
Cognitive Bias Detection Using Advanced Prompt Engineering—0
Visual Reasoning Evaluation of Grok, Deepseek Janus, Gemini, Qwen, Mistral, and ChatGPT—0
Robust Bias Detection in MLMs and its Application to Human Trait RatingsCode0
Detecting Linguistic Bias in Government Documents Using Large language Models—0
Towards Equitable AI: Detecting Bias in Using Large Language Models for Marketing—0
BiaSWE: An Expert Annotated Dataset for Misogyny Detection in Swedish—0
FairT2I: Mitigating Social Bias in Text-to-Image Generation via Large Language Model-Assisted Detection and Attribute Rebalancing—0
LLMs can be easily Confused by Instructional Distractions—0
Sample Complexity of Bias Detection with Subsampled Point-to-Subspace Distances—0
Bias Detection via Maximum Subgroup Discrepancy—0
Auditing a Dutch Public Sector Risk Profiling Algorithm Using an Unsupervised Bias Detection Tool—0
Show:102550
← PrevPage 1 of 4Next →
All datasetsStereoSetrt-inod-biasICAT LLM biasPlantVillage_8pxWiki Neutrality Corpus

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97—Unverified
2XLNet (large)ICAT Score72.03—Unverified
3GPT-2 (medium)ICAT Score71.73—Unverified
4BERT (base)ICAT Score71.21—Unverified
5GPT-2 (large)ICAT Score70.54—Unverified
6BERT (large)ICAT Score69.89—Unverified
7RoBERTa (base)ICAT Score67.5—Unverified
8GAL 120BICAT Score65.6—Unverified
9XLNet (base)ICAT Score62.1—Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5—Unverified
2GemmaBest-of0.41—Unverified
3BaselineBest-of0.41—Unverified
4MistralBest-of0.36—Unverified
5Llama2Best-of0.34—Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44—Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4—Unverified