SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 126–150 of 199 papers

TitleStatusHype
Unboxing Occupational Bias: Grounded Debiasing of LLMs with U.S. Labor Data—0
Uncovering Biases with Reflective Large Language Models—0
Unlocking Bias Detection: Leveraging Transformer-Based Models for Content Analysis—0
Unmasking Bias in AI: A Systematic Review of Bias Detection and Mitigation Strategies in Electronic Health Record-based Models—0
Unmasking Conversational Bias in AI Multiagent Systems—0
Unsupervised Bias Detection in College Student Newspapers—0
Visual Reasoning Evaluation of Grok, Deepseek Janus, Gemini, Qwen, Mistral, and ChatGPT—0
With a Grain of SALT: Are LLMs Fair Across Social Dimensions?—0
Efficient Fairness Testing in Large Language Models: Prioritizing Metamorphic Relations for Bias Detection—0
Efficient Gender Debiasing of Pre-trained Indic Language Models—0
Enhancing Bias Detection in Political News Using Pragmatic Presupposition—0
Mitigating the Risk of Health Inequity Exacerbated by Large Language Models—0
Epistemological Bias As a Means for the Automated Detection of Injustices in Text—0
Evaluating AI fairness in credit scoring with the BRIO tool—0
Evaluating Fairness Metrics in the Presence of Dataset Bias—0
Experiments in News Bias Detection with Pre-Trained Neural Transformers—0
Don’t Discard All the Biased Instances: Investigating a Core Assumption in Dataset Bias Mitigation TechniquesCode0
A methodology to characterize bias and harmful stereotypes in natural language processing in Latin AmericaCode0
Context in Informational Bias DetectionCode0
To Bias or Not to Bias: Detecting bias in News with bias-detectorCode0
Multilingual sentence-level bias detection in WikipediaCode0
Don't Discard All the Biased Instances: Investigating a Core Assumption in Dataset Bias Mitigation TechniquesCode0
MAGPIE: Multi-Task Media-Bias Analysis Generalization for Pre-Trained Identification of ExpressionsCode0
My Approach = Your Apparatus? Entropy-Based Topic Modeling on Multiple Domain-Specific Text CollectionsCode0
Can Global XAI Methods Reveal Injected Bias in LLMs? SHAP vs Rule Extraction vs RuleSHAPCode0
Show:102550
← PrevPage 6 of 8Next →
All datasetsStereoSetrt-inod-biasICAT LLM biasPlantVillage_8pxWiki Neutrality Corpus

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97—Unverified
2XLNet (large)ICAT Score72.03—Unverified
3GPT-2 (medium)ICAT Score71.73—Unverified
4BERT (base)ICAT Score71.21—Unverified
5GPT-2 (large)ICAT Score70.54—Unverified
6BERT (large)ICAT Score69.89—Unverified
7RoBERTa (base)ICAT Score67.5—Unverified
8GAL 120BICAT Score65.6—Unverified
9XLNet (base)ICAT Score62.1—Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5—Unverified
2BaselineBest-of0.41—Unverified
3GemmaBest-of0.41—Unverified
4MistralBest-of0.36—Unverified
5Llama2Best-of0.34—Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44—Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4—Unverified