SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Showing 151199 of 199 papers

TitleStatusHype
Bipol: Multi-axes Evaluation of Bias with Explainability in Benchmark DatasetsCode0
DispaRisk: Auditing Fairness Through Usable InformationCode0
Disentangling Structure and Style: Political Bias Detection in News by Inducing Document HierarchyCode0
ViLBias: A Comprehensive Framework for Bias Detection through Linguistic and Visual Cues , presenting Annotation Strategies, Evaluation, and Key ChallengesCode0
Automated Dependence PlotsCode0
NewB: 200,000+ Sentences for Political Bias DetectionCode0
Bipol: A Novel Multi-Axes Bias Evaluation Metric with Explainability for NLPCode0
Fair is Better than Sensational:Man is to Doctor as Woman is to DoctorCode0
fairmodels: A Flexible Tool For Bias Detection, Visualization, And MitigationCode0
A Study of Nationality Bias in Names and Perplexity using Off-the-Shelf Affect-related Tweet ClassifiersCode0
A Unified Comparison of User Modeling Techniques for Predicting Data Interaction and Detecting Exploration BiasCode0
Trade-Offs Between Fairness and Privacy in Language ModelingCode0
Fine-grained Classification of Political Bias in German News: A Data Set and Initial ExperimentsCode0
Forward Composition Propagation for Explainable Neural ReasoningCode0
Detection of Puffery on the English WikipediaCode0
Gender Bias Detection in Court Decisions: A Brazilian Case StudyCode0
Detecting Media Bias in News Articles using Gaussian Bias DistributionsCode0
GradBias: Unveiling Word Influence on Bias in Text-to-Image Generative ModelsCode0
GUS-Net: Social Bias Classification in Text with Generalizations, Unfairness, and StereotypesCode0
HeteroCorpus: A Corpus for Heteronormative Language DetectionCode0
How Neural Networks Organize Concepts: Introducing Concept Trajectory Analysis for Deep Learning InterpretabilityCode0
How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contextsCode0
IFBiD: Inference-Free Bias DetectionCode0
Predicting the Leading Political Ideology of YouTube Channels Using Acoustic, Textual, and Metadata InformationCode0
Towards Automatic Bias Detection in Knowledge GraphsCode0
Quantifying Gender Biases Towards Politicians on RedditCode0
IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias IndicatorsCode0
Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM InteractionsCode0
The BIAS Detection Framework: Bias Detection in Word Embeddings and Language Models for European LanguagesCode0
DeNetDM: Debiasing by Network Depth ModulationCode0
A Domain-adaptive Pre-training Approach for Language Bias Detection in NewsCode0
Investigating Subtler Biases in LLMs: Ageism, Beauty, Institutional, and Nationality Bias in Generative ModelsCode0
Robust Bias Detection in MLMs and its Application to Human Trait RatingsCode0
Language-Agnostic Bias Detection in Language Models with Bias ProbingCode0
RuBia: A Russian Language Bias Detection DatasetCode0
Towards Detection of Subjective Bias using Contextualized Word EmbeddingsCode0
Corpora Evaluation and System Bias Detection in Multi-document SummarizationCode0
Second Order WinoBias (SoWinoBias) Test Set for Latent Gender Bias Detection in Coreference ResolutionCode0
LOGAN: Local Group Bias Detection by ClusteringCode0
LUCID-GAN: Conditional Generative Models to Locate UnfairnessCode0
The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media BiasCode0
debiaSAE: Benchmarking and Mitigating Vision-Language Model BiasCode0
Uncovering bias in the PlantVillage datasetCode0
Measuring Gender Bias in Word Embeddings across Domains and Discovering New Gender Bias Word CategoriesCode0
The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias DetectionCode0
Mind Your Bias: A Critical Review of Bias Detection Methods for Contextual Language ModelsCode0
Mitigating Bias in Queer Representation within Large Language Models: A Collaborative Agent ApproachCode0
Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious BiasCode0
TinyEmo: Scaling down Emotional Reasoning via Metric ProjectionCode0
Show:102550
← PrevPage 4 of 4Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97Unverified
2XLNet (large)ICAT Score72.03Unverified
3GPT-2 (medium)ICAT Score71.73Unverified
4BERT (base)ICAT Score71.21Unverified
5GPT-2 (large)ICAT Score70.54Unverified
6BERT (large)ICAT Score69.89Unverified
7RoBERTa (base)ICAT Score67.5Unverified
8GAL 120BICAT Score65.6Unverified
9XLNet (base)ICAT Score62.1Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5Unverified
2GemmaBest-of0.41Unverified
3BaselineBest-of0.41Unverified
4MistralBest-of0.36Unverified
5Llama2Best-of0.34Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4Unverified