SOTAVerified

Hate Speech Detection

Hate speech detection is the task of detecting if communication such as text, audio, and so on contains hatred and or encourages violence towards a person or a group of people. This is usually based on prejudice against 'protected characteristics' such as their ethnicity, gender, sexual orientation, religion, age et al. Some example benchmarks are ETHOS and HateXplain. Models can be evaluated with metrics like the F-score or F-measure.

Papers

Showing 121130 of 507 papers

TitleStatusHype
Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languages0
Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?0
A Study on Bias Detection and Classification in Natural Language Processing0
An Investigation Into Explainable Audio Hate Speech Detection0
Hate Speech Detection and Classification in Amharic Text with Deep Learning0
LAMPO: Large Language Models as Preference Machines for Few-shot Ordinal Classification0
Ensemble of pre-trained language models and data augmentation for hate speech detection from Arabic tweets0
A Study of Nationality Bias in Names and Perplexity using Off-the-Shelf Affect-related Tweet ClassifiersCode0
Sociocultural Considerations in Monitoring Anti-LGBTQ+ Content on Social Media0
Watching the Watchers: A Comparative Fairness Audit of Cloud-based Content Moderation Services0
Show:102550
← PrevPage 13 of 51Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1BiLSTM + static BEF1-score0.8Unverified
2BERTF1-score0.79Unverified
3BiLSTM+Attention+FTF1-score0.77Unverified
4OPT-175B (few-shot)F1-score0.76Unverified
5CNN+Attention+FT+GVF1-score0.74Unverified
6OPT-175B (one-shot)F1-score0.71Unverified
7OPT-175B (zero-shot)F1-score0.67Unverified
8SVMF1-score0.66Unverified
9Random ForestsF1-score0.64Unverified
10Davinci (zero-shot)F1-score0.63Unverified
#ModelMetricClaimedVerifiedStatus
1BERT-MRPAUROC0.86Unverified
2BERT-RPAUROC0.85Unverified
3BERT-HateXplain [Attn]AUROC0.85Unverified
4BERT-HateXplain [LIME]AUROC0.85Unverified
5BERT [Attn]AUROC0.84Unverified
6BiRNN-HateXplain [Attn]AUROC0.81Unverified
7BiRNN-Attn [Attn]AUROC0.8Unverified
8CNN-GRU [LIME]AUROC0.79Unverified
9BiRNN [LIME]AUROC0.77Unverified
10XG-HSI-BERTAccuracy0.75Unverified
#ModelMetricClaimedVerifiedStatus
1MLARAMHamming Loss0.29Unverified
2MLkNNHamming Loss0.16Unverified
3Binary RelevanceHamming Loss0.14Unverified
4Neural Classifier ChainsHamming Loss0.13Unverified
5Neural Binary RelevanceHamming Loss0.11Unverified
#ModelMetricClaimedVerifiedStatus
1Mozafari et al., 2019AAA50.94Unverified
2SVMAAA46.51Unverified
3Kennedy et al., 2020AAA45.5Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.74Unverified
2BERTMacro F10.72Unverified
#ModelMetricClaimedVerifiedStatus
1mBertAccuracy0.83Unverified
2Logistic RegressionAccuracy0.7Unverified
#ModelMetricClaimedVerifiedStatus
1HXP + CLAP + CLIPTEST F1 (macro)0.85Unverified
2BERT + ViT + MFCCTEST F1 (macro)0.79Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.49Unverified
2BERTMacro F10.48Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.81Unverified
2BERTMacro F10.8Unverified
#ModelMetricClaimedVerifiedStatus
1Multilingual BERTF1-score0.75Unverified
2AutoMLF1-score0.74Unverified
#ModelMetricClaimedVerifiedStatus
1AOM mBERTF10.85Unverified
#ModelMetricClaimedVerifiedStatus
1BaselineF10.7Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa-large-STMacro F180.7Unverified
#ModelMetricClaimedVerifiedStatus
1Baseline BERT (task A)F10.77Unverified