SOTAVerified

Bias Detection

Bias detection is the task of detecting and measuring racism, sexism and otherwise discriminatory behavior in a model (Source: https://stereoset.mit.edu/)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 76–100 of 199 papers

TitleStatusHype
Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Models—0
The BIAS Detection Framework: Bias Detection in Word Embeddings and Language Models for European LanguagesCode0
BiasScanner: Automatic Detection and Classification of News Bias to Strengthen Democracy—0
BiasAlert: A Plug-and-play Tool for Social Bias Detection in LLMs—0
A Review of the Challenges with Massive Web-mined Corpora Used in Large Language Models Pre-Training—0
Epistemological Bias As a Means for the Automated Detection of Injustices in Text—0
Seeing Like an AI: How LLMs Apply (and Misapply) Wikipedia Neutrality Norms—0
Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious BiasCode0
A Study of Nationality Bias in Names and Perplexity using Off-the-Shelf Affect-related Tweet ClassifiersCode0
DocNet: Semantic Structure in Inductive Bias Detection Models—0
Experiments in News Bias Detection with Pre-Trained Neural Transformers—0
BEADs: Bias Evaluation Across Domains—0
Evaluating AI fairness in credit scoring with the BRIO tool—0
Gender Bias Detection in Court Decisions: A Brazilian Case StudyCode0
The Point of View of a Sentiment: Towards Clinician Bias Detection in Psychiatric Notes—0
DispaRisk: Auditing Fairness Through Usable InformationCode0
A Novel Method for News Article Event-Based Embedding—0
A Deep Dive into Effects of Structural Bias on CMA-ES Performance along Affine Trajectories—0
Reinforcement Learning from Multi-role Debates as Feedback for Bias Mitigation in LLMs—0
The Impact of Unstated Norms in Bias Analysis of Language Models—0
ChatGPT v.s. Media Bias: A Comparative Study of GPT-3.5 and Fine-tuned Language Models—0
Implications of the AI Act for Non-Discrimination Law and Algorithmic Fairness—0
DeNetDM: Debiasing by Network Depth ModulationCode0
RuBia: A Russian Language Bias Detection DatasetCode0
MAGPIE: Multi-Task Media-Bias Analysis Generalization for Pre-Trained Identification of ExpressionsCode0
Show:102550
← PrevPage 4 of 8Next →
All datasetsStereoSetrt-inod-biasICAT LLM biasPlantVillage_8pxWiki Neutrality Corpus

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-2 (small)ICAT Score72.97—Unverified
2XLNet (large)ICAT Score72.03—Unverified
3GPT-2 (medium)ICAT Score71.73—Unverified
4BERT (base)ICAT Score71.21—Unverified
5GPT-2 (large)ICAT Score70.54—Unverified
6BERT (large)ICAT Score69.89—Unverified
7RoBERTa (base)ICAT Score67.5—Unverified
8GAL 120BICAT Score65.6—Unverified
9XLNet (base)ICAT Score62.1—Unverified
10GPT-3 (text-davinci-002)ICAT Score60.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Best-of0.5—Unverified
2BaselineBest-of0.41—Unverified
3GemmaBest-of0.41—Unverified
4MistralBest-of0.36—Unverified
5Llama2Best-of0.34—Unverified
#ModelMetricClaimedVerifiedStatus
1BADICAT Score23.44—Unverified
#ModelMetricClaimedVerifiedStatus
1RandomForest_default_hyperparametersAccuracy (%)49—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa+ALBERTF170.4—Unverified