SOTAVerified

Hate Speech Detection

Hate speech detection is the task of detecting if communication such as text, audio, and so on contains hatred and or encourages violence towards a person or a group of people. This is usually based on prejudice against 'protected characteristics' such as their ethnicity, gender, sexual orientation, religion, age et al. Some example benchmarks are ETHOS and HateXplain. Models can be evaluated with metrics like the F-score or F-measure.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 507 papers

TitleStatusHype
Incorporating Human Explanations for Robust Hate Speech Detection—0
ImpScore: A Learnable Metric For Quantifying The Implicitness Level of LanguageCode0
Multi3Hate: Multimodal, Multilingual, and Multicultural Hate Speech Detection with Vision-Language ModelsCode1
Who Speaks Matters: Analysing the Influence of the Speaker's Ethnicity on Hate Classification—0
DefVerify: Do Hate Speech Models Reflect Their Dataset's Definition?Code0
BanTH: A Multi-label Hate Speech Detection Dataset for Transliterated Bangla—0
Exploring Large Language Models for Hate Speech Detection in Rioplatense Spanish—0
"Is Hate Lost in Translation?": Evaluation of Multilingual LGBTQIA+ Hate Speech Detection—0
A Target-Aware Analysis of Data Augmentation for Hate Speech Detection—0
Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targets—0
Bridging Modalities: Enhancing Cross-Modality Hate Speech Detection with Few-Shot In-Context Learning—0
Hate Speech Detection Using Cross-Platform Social Media Data In English and German LanguageCode0
ThreatGram 101 - Extreme Telegram Replies Data with Threat LevelsCode0
Leveraging Annotator Disagreement for Text Classification—0
What is the social benefit of hate speech detection research? A Systematic Review—0
An Effective, Robust and Fairness-aware Hate Speech Detection Framework—0
SWE2: SubWord Enriched and Significant Word Emphasized Framework for Hate Speech Detection—0
Safe Guard: an LLM-agent for Real-time Voice-based Hate Speech Detection in Social Virtual Reality—0
Trustworthy Hate Speech Detection Through Visual Augmentation—0
DetoxBench: Benchmarking Large Language Models for Multitask Fraud & Abuse Detection—0
Mpox Narrative on Instagram: A Labeled Multilingual Dataset of Instagram Posts on Mpox for Sentiment, Hate Speech, and Anxiety Analysis—0
MHS-STMA: Multimodal Hate Speech Detection via Scalable Transformer-Based Multilevel Attention Framework—0
Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languages—0
Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?—0
A Study on Bias Detection and Classification in Natural Language Processing—0
An Investigation Into Explainable Audio Hate Speech Detection—0
Hate Speech Detection and Classification in Amharic Text with Deep Learning—0
LAMPO: Large Language Models as Preference Machines for Few-shot Ordinal Classification—0
MultiHateClip: A Multilingual Benchmark Dataset for Hateful Video Detection on YouTube and BilibiliCode1
Ensemble of pre-trained language models and data augmentation for hate speech detection from Arabic tweets—0
Sociocultural Considerations in Monitoring Anti-LGBTQ+ Content on Social Media—0
A Study of Nationality Bias in Names and Perplexity using Off-the-Shelf Affect-related Tweet ClassifiersCode0
Watching the Watchers: A Comparative Fairness Audit of Cloud-based Content Moderation Services—0
Investigating Annotator Bias in Large Language Models for Hate Speech DetectionCode0
Label-aware Hard Negative Sampling Strategies with Momentum Contrastive Learning for Implicit Hate Speech DetectionCode0
Silent Signals, Loud Impact: LLMs for Word-Sense Disambiguation of Coded Dog Whistles—0
HateDebias: On the Diversity and Variability of Hate Speech Debiasing—0
A multilingual dataset for offensive language and hate speech detection for hausa, yoruba and igbo languages—0
Hate Speech Detection with Generalizable Target-aware FairnessCode0
ViHateT5: Enhancing Hate Speech Detection in Vietnamese With A Unified Text-to-Text Transformer ModelCode0
A Systematic Analysis on the Temporal Generalization of Language Models in Social Media—0
Bridging the gap in online hate speech detection: a comparative analysis of BERT and traditional models for homophobic content identification on X/Twitter—0
Unveiling Social Media Comments with a Novel Named Entity Recognition System for Identity Groups—0
Detecting Anti-Semitic Hate Speech using Transformer-based Large Language Models—0
SGHateCheck: Functional Tests for Detecting Hate Speech in Low-Resource Languages of Singapore—0
ViTHSD: Exploiting Hatred by Targets for Hate Speech Detection on Vietnamese Social Media TextsCode0
Human-in-the-Loop Synthetic Text Data Inspection with Provenance TrackingCode0
EkoHate: Abusive Language and Hate Speech Detection for Code-switched Political Discussions on Nigerian TwitterCode0
Cross-Platform Hate Speech Detection with Weakly Supervised Causal Disentanglement—0
Exploring the Trade-off Between Model Performance and Explanation Plausibility of Text Classifiers Using Human RationalesCode0
Show:102550
← PrevPage 2 of 11Next →
All datasetsEthos BinaryHateXplainEthos MultiLabelWaseem et al., 2018AbusEvalAutomatic Misogynistic IdentificationHateMMHatEvalOffensEval 2019ToLD-Brbajer_danish_misogynyDKhate

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1BiLSTM + static BEF1-score0.8—Unverified
2BERTF1-score0.79—Unverified
3BiLSTM+Attention+FTF1-score0.77—Unverified
4OPT-175B (few-shot)F1-score0.76—Unverified
5CNN+Attention+FT+GVF1-score0.74—Unverified
6OPT-175B (one-shot)F1-score0.71—Unverified
7OPT-175B (zero-shot)F1-score0.67—Unverified
8SVMF1-score0.66—Unverified
9Random ForestsF1-score0.64—Unverified
10Davinci (zero-shot)F1-score0.63—Unverified
#ModelMetricClaimedVerifiedStatus
1BERT-MRPAUROC0.86—Unverified
2BERT-RPAUROC0.85—Unverified
3BERT-HateXplain [LIME]AUROC0.85—Unverified
4BERT-HateXplain [Attn]AUROC0.85—Unverified
5BERT [Attn]AUROC0.84—Unverified
6BiRNN-HateXplain [Attn]AUROC0.81—Unverified
7BiRNN-Attn [Attn]AUROC0.8—Unverified
8CNN-GRU [LIME]AUROC0.79—Unverified
9BiRNN [LIME]AUROC0.77—Unverified
10XG-HSI-BERTAccuracy0.75—Unverified
#ModelMetricClaimedVerifiedStatus
1MLARAMHamming Loss0.29—Unverified
2MLkNNHamming Loss0.16—Unverified
3Binary RelevanceHamming Loss0.14—Unverified
4Neural Classifier ChainsHamming Loss0.13—Unverified
5Neural Binary RelevanceHamming Loss0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1Mozafari et al., 2019AAA50.94—Unverified
2SVMAAA46.51—Unverified
3Kennedy et al., 2020AAA45.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.74—Unverified
2BERTMacro F10.72—Unverified
#ModelMetricClaimedVerifiedStatus
1mBertAccuracy0.83—Unverified
2Logistic RegressionAccuracy0.7—Unverified
#ModelMetricClaimedVerifiedStatus
1HXP + CLAP + CLIPTEST F1 (macro)0.85—Unverified
2BERT + ViT + MFCCTEST F1 (macro)0.79—Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.49—Unverified
2BERTMacro F10.48—Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.81—Unverified
2BERTMacro F10.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Multilingual BERTF1-score0.75—Unverified
2AutoMLF1-score0.74—Unverified
#ModelMetricClaimedVerifiedStatus
1AOM mBERTF10.85—Unverified
#ModelMetricClaimedVerifiedStatus
1BaselineF10.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa-large-STMacro F180.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Baseline BERT (task A)F10.77—Unverified