SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 26–50 of 199 papers

TitleStatusHype
Auditing a Dutch Public Sector Risk Profiling Algorithm Using an Unsupervised Bias Detection Tool—0
Unmasking Conversational Bias in AI Multiagent Systems—0
Decoding News Bias: Multi Bias Detection in News Articles—0
Classifier-to-Bias: Toward Unsupervised Automatic Bias Detection for Visual Classifiers—0
ViLBias: A Comprehensive Framework for Bias Detection through Linguistic and Visual Cues , presenting Annotation Strategies, Evaluation, and Key ChallengesCode0
Improved Models for Media Bias Detection and Subcategorization—0
MT-LENS: An all-in-one Toolkit for Better Machine Translation EvaluationCode1
Towards Understanding and Quantifying Uncertainty for Text-to-Image Generation—0
MediaSpin: Exploring Media Bias Through Fine-Grained Analysis of News Headlines—0
Bias Analysis of AI Models for Undergraduate Student Admissions—0
The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias DetectionCode0
Bias in Large Language Models: Origin, Evaluation, and Mitigation—0
Mitigating Bias in Queer Representation within Large Language Models: A Collaborative Agent ApproachCode0
Current State-of-the-Art of Bias Detection and Mitigation in Machine Translation for African and European Languages: a Review—0
Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Play—0
Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AI—0
debiaSAE: Benchmarking and Mitigating Vision-Language Model BiasCode0
With a Grain of SALT: Are LLMs Fair Across Social Dimensions?—0
GUS-Net: Social Bias Classification in Text with Generalizations, Unfairness, and StereotypesCode0
TinyEmo: Scaling down Emotional Reasoning via Metric ProjectionCode0
Mitigating the Risk of Health Inequity Exacerbated by Large Language Models—0
Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM InteractionsCode0
Counterfactual Token Generation in Large Language ModelsCode1
Towards Fairer Health Recommendations: finding informative unbiased samples via Word Sense Disambiguation—0
Explainable AI for computational pathology identifies model limitations and tissue biomarkersCode1
Show:102550
← PrevPage 2 of 8Next →
All datasetsStereoSetrt-inod-biasICAT LLM biasPlantVillage_8pxWiki Neutrality Corpus

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97—Unverified
2XLNet (large)ICAT Score72.03—Unverified
3GPT-2 (medium)ICAT Score71.73—Unverified
4BERT (base)ICAT Score71.21—Unverified
5GPT-2 (large)ICAT Score70.54—Unverified
6BERT (large)ICAT Score69.89—Unverified
7RoBERTa (base)ICAT Score67.5—Unverified
8GAL 120BICAT Score65.6—Unverified
9XLNet (base)ICAT Score62.1—Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5—Unverified
2BaselineBest-of0.41—Unverified
3GemmaBest-of0.41—Unverified
4MistralBest-of0.36—Unverified
5Llama2Best-of0.34—Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44—Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4—Unverified