SOTAVerified

Hate Speech Detection

Hate speech detection is the task of detecting if communication such as text, audio, and so on contains hatred and or encourages violence towards a person or a group of people. This is usually based on prejudice against 'protected characteristics' such as their ethnicity, gender, sexual orientation, religion, age et al. Some example benchmarks are ETHOS and HateXplain. Models can be evaluated with metrics like the F-score or F-measure.

Papers

Showing 5175 of 507 papers

TitleStatusHype
Incorporating Human Explanations for Robust Hate Speech Detection0
ImpScore: A Learnable Metric For Quantifying The Implicitness Level of LanguageCode0
Multi3Hate: Multimodal, Multilingual, and Multicultural Hate Speech Detection with Vision-Language ModelsCode1
Who Speaks Matters: Analysing the Influence of the Speaker's Ethnicity on Hate Classification0
DefVerify: Do Hate Speech Models Reflect Their Dataset's Definition?Code0
BanTH: A Multi-label Hate Speech Detection Dataset for Transliterated Bangla0
Exploring Large Language Models for Hate Speech Detection in Rioplatense Spanish0
"Is Hate Lost in Translation?": Evaluation of Multilingual LGBTQIA+ Hate Speech Detection0
A Target-Aware Analysis of Data Augmentation for Hate Speech Detection0
Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targets0
Bridging Modalities: Enhancing Cross-Modality Hate Speech Detection with Few-Shot In-Context Learning0
Hate Speech Detection Using Cross-Platform Social Media Data In English and German LanguageCode0
ThreatGram 101 - Extreme Telegram Replies Data with Threat LevelsCode0
What is the social benefit of hate speech detection research? A Systematic Review0
Leveraging Annotator Disagreement for Text Classification0
An Effective, Robust and Fairness-aware Hate Speech Detection Framework0
SWE2: SubWord Enriched and Significant Word Emphasized Framework for Hate Speech Detection0
Safe Guard: an LLM-agent for Real-time Voice-based Hate Speech Detection in Social Virtual Reality0
Trustworthy Hate Speech Detection Through Visual Augmentation0
DetoxBench: Benchmarking Large Language Models for Multitask Fraud & Abuse Detection0
Mpox Narrative on Instagram: A Labeled Multilingual Dataset of Instagram Posts on Mpox for Sentiment, Hate Speech, and Anxiety Analysis0
MHS-STMA: Multimodal Hate Speech Detection via Scalable Transformer-Based Multilevel Attention Framework0
Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languages0
Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?0
A Study on Bias Detection and Classification in Natural Language Processing0
Show:102550
← PrevPage 3 of 21Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1BiLSTM + static BEF1-score0.8Unverified
2BERTF1-score0.79Unverified
3BiLSTM+Attention+FTF1-score0.77Unverified
4OPT-175B (few-shot)F1-score0.76Unverified
5CNN+Attention+FT+GVF1-score0.74Unverified
6OPT-175B (one-shot)F1-score0.71Unverified
7OPT-175B (zero-shot)F1-score0.67Unverified
8SVMF1-score0.66Unverified
9Random ForestsF1-score0.64Unverified
10Davinci (zero-shot)F1-score0.63Unverified
#ModelMetricClaimedVerifiedStatus
1BERT-MRPAUROC0.86Unverified
2BERT-RPAUROC0.85Unverified
3BERT-HateXplain [LIME]AUROC0.85Unverified
4BERT-HateXplain [Attn]AUROC0.85Unverified
5BERT [Attn]AUROC0.84Unverified
6BiRNN-HateXplain [Attn]AUROC0.81Unverified
7BiRNN-Attn [Attn]AUROC0.8Unverified
8CNN-GRU [LIME]AUROC0.79Unverified
9BiRNN [LIME]AUROC0.77Unverified
10XG-HSI-BERTAccuracy0.75Unverified
#ModelMetricClaimedVerifiedStatus
1MLARAMHamming Loss0.29Unverified
2MLkNNHamming Loss0.16Unverified
3Binary RelevanceHamming Loss0.14Unverified
4Neural Classifier ChainsHamming Loss0.13Unverified
5Neural Binary RelevanceHamming Loss0.11Unverified
#ModelMetricClaimedVerifiedStatus
1Mozafari et al., 2019AAA50.94Unverified
2SVMAAA46.51Unverified
3Kennedy et al., 2020AAA45.5Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.74Unverified
2BERTMacro F10.72Unverified
#ModelMetricClaimedVerifiedStatus
1mBertAccuracy0.83Unverified
2Logistic RegressionAccuracy0.7Unverified
#ModelMetricClaimedVerifiedStatus
1HXP + CLAP + CLIPTEST F1 (macro)0.85Unverified
2BERT + ViT + MFCCTEST F1 (macro)0.79Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.49Unverified
2BERTMacro F10.48Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.81Unverified
2BERTMacro F10.8Unverified
#ModelMetricClaimedVerifiedStatus
1Multilingual BERTF1-score0.75Unverified
2AutoMLF1-score0.74Unverified
#ModelMetricClaimedVerifiedStatus
1AOM mBERTF10.85Unverified
#ModelMetricClaimedVerifiedStatus
1BaselineF10.7Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa-large-STMacro F180.7Unverified
#ModelMetricClaimedVerifiedStatus
1Baseline BERT (task A)F10.77Unverified