SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–199 of 199 papers

TitleStatusHype
BiasGuard: A Reasoning-enhanced Bias Detection Tool For Large Language Models—0
Bias in Large Language Models: Origin, Evaluation, and Mitigation—0
Bias in word embeddings—0
BiasLab: Toward Explainable Political Bias Detection with Dual-Axis Annotations and Rationale Indicators—0
BiasScanner: Automatic Detection and Classification of News Bias to Strengthen Democracy—0
BiaSWE: An Expert Annotated Dataset for Misogyny Detection in Swedish—0
Personalized Detection of Cognitive Biases in Actions of Users from Their Logs: Anchoring and Recency Biases—0
Towards Equitable AI: Detecting Bias in Using Large Language Models for Marketing—0
Can we Debias Social Stereotypes in AI-Generated Images? Examining Text-to-Image Outputs and User Perceptions—0
Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AI—0
Cascading Adversarial Bias from Injection to Distillation in Language Models—0
Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2021): Workshop and Shared Task Report—0
ChatGPT v.s. Media Bias: A Comparative Study of GPT-3.5 and Fine-tuned Language Models—0
Classifier-to-Bias: Toward Unsupervised Automatic Bias Detection for Visual Classifiers—0
Cognitive Bias Detection Using Advanced Prompt Engineering—0
Constructive Interpretability with CoLabel: Corroborative Integration, Complementary Features, and Collaborative Learning—0
Pseudo-labelling Enhanced Media Bias Detection—0
Towards Fairer Health Recommendations: finding informative unbiased samples via Word Sense Disambiguation—0
BENN: Bias Estimation Using Deep Neural Network—0
Detecting Cross-Geographic Biases in Toxicity Modeling on Social Media—0
Current State-of-the-Art of Bias Detection and Mitigation in Machine Translation for African and European Languages: a Review—0
Current Topological and Machine Learning Applications for Bias Detection in Text—0
BEADs: Bias Evaluation Across Domains—0
Reinforcement Learning from Multi-role Debates as Feedback for Bias Mitigation in LLMs—0
Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Models—0
Decoding News Bias: Multi Bias Detection in News Articles—0
Decoding News Narratives: A Critical Analysis of Large Language Models in Framing Detection—0
Deep Learning for Bias Detection: From Inception to Deployment—0
Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Play—0
Designing Tools for Semi-Automated Detection of Machine Learning Biases: An Interview Study—0
Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema—0
Detecting Gender Bias in Transformer-based Models: A Case Study on BERT—0
Detecting Linguistic Bias in Government Documents Using Large language Models—0
The Impact of Unstated Norms in Bias Analysis of Language Models—0
Detecting Political Bias in News Articles Using Headline Attention—0
Robots Enact Malignant Stereotypes—0
Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarks—0
Unsupervised Bias Detection in College Student Newspapers—0
Sample Complexity of Bias Detection with Subsampled Point-to-Subspace Distances—0
DocNet: Semantic Structure in Inductive Bias Detection Models—0
Towards Understanding and Quantifying Uncertainty for Text-to-Image Generation—0
Seeing Like an AI: How LLMs Apply (and Misapply) Wikipedia Neutrality Norms—0
Efficient Fairness Testing in Large Language Models: Prioritizing Metamorphic Relations for Bias Detection—0
Efficient Gender Debiasing of Pre-trained Indic Language Models—0
Enhancing Bias Detection in Political News Using Pragmatic Presupposition—0
Mitigating the Risk of Health Inequity Exacerbated by Large Language Models—0
Auditing Predictive Models for Intersectional Biases—0
Epistemological Bias As a Means for the Automated Detection of Injustices in Text—0
Evaluating AI fairness in credit scoring with the BRIO tool—0
Show:102550
← PrevPage 4 of 4Next →
All datasetsStereoSetrt-inod-biasICAT LLM biasPlantVillage_8pxWiki Neutrality Corpus

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97—Unverified
2XLNet (large)ICAT Score72.03—Unverified
3GPT-2 (medium)ICAT Score71.73—Unverified
4BERT (base)ICAT Score71.21—Unverified
5GPT-2 (large)ICAT Score70.54—Unverified
6BERT (large)ICAT Score69.89—Unverified
7RoBERTa (base)ICAT Score67.5—Unverified
8GAL 120BICAT Score65.6—Unverified
9XLNet (base)ICAT Score62.1—Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5—Unverified
2GemmaBest-of0.41—Unverified
3BaselineBest-of0.41—Unverified
4MistralBest-of0.36—Unverified
5Llama2Best-of0.34—Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44—Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4—Unverified