SOTAVerified

Hate Speech Detection

Hate speech detection is the task of detecting if communication such as text, audio, and so on contains hatred and or encourages violence towards a person or a group of people. This is usually based on prejudice against 'protected characteristics' such as their ethnicity, gender, sexual orientation, religion, age et al. Some example benchmarks are ETHOS and HateXplain. Models can be evaluated with metrics like the F-score or F-measure.

Papers

Showing 276–300 of 507 papers

TitleStatusHype
OPT: Open Pre-trained Transformer Language ModelsCode5
Darkness can not drive out darkness: Investigating Bias in Hate SpeechDetection Models—0
Benchmarking Post-Hoc Interpretability Approaches for Transformer-based Misogyny DetectionCode0
HateCheckHIn: Evaluating Hindi Hate Speech Detection ModelsCode0
Placing M-Phasis on the Plurality of Hate: A Feature-Based Corpus of Hate OnlineCode0
Multimodal Hate Speech Detection from Bengali Memes and TextsCode0
Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi—0
Fairly Accurate: Learning Optimal Accuracy vs. Fairness Tradeoffs for Hate Speech Detection—0
Anti-Asian Hate Speech Detection via Data Augmented Semantic Relation Inference—0
CRUSH: Contextually Regularized and User anchored Self-supervised Hate speech DetectionCode0
Easy Adaptation to Mitigate Gender Bias in Multilingual Text ClassificationCode0
Checking HateCheck: a cross-functional analysis of behaviour-aware learning for hate speech detectionCode0
Reinforcement Guided Multi-Task Learning Framework for Low-Resource Stereotype DetectionCode0
L3Cube-MahaHate: A Tweet-based Marathi Hate Speech Detection Dataset and BERT models—0
Dynamically Refined Regularization for Improving Cross-corpora Hate Speech DetectionCode0
Entropy-based Attention Regularization Frees Unintended Bias Mitigation from ListsCode1
ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech DetectionCode2
Large-Scale Hate Speech Detection with Cross-Domain TransferCode1
APEACH: Attacking Pejorative Expressions with Analysis on Crowd-Generated Hate Speech Evaluation DatasetsCode1
Deep Learning for Hate Speech Detection: A Comparative StudyCode1
Emotion Based Hate Speech Detection using Multimodal Learning—0
Calibrated Learning to Defer with One-vs-All ClassifiersCode0
Dominant Set-based Active Learning for Text Classification and its Application to Online Social Media—0
Going Extreme: Comparative Analysis of Hate Speech in Parler and GabCode0
Highly Generalizable Models for Multilingual Hate Speech DetectionCode0
Show:102550
← PrevPage 12 of 21Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1BiLSTM + static BEF1-score0.8—Unverified
2BERTF1-score0.79—Unverified
3BiLSTM+Attention+FTF1-score0.77—Unverified
4OPT-175B (few-shot)F1-score0.76—Unverified
5CNN+Attention+FT+GVF1-score0.74—Unverified
6OPT-175B (one-shot)F1-score0.71—Unverified
7OPT-175B (zero-shot)F1-score0.67—Unverified
8SVMF1-score0.66—Unverified
9Random ForestsF1-score0.64—Unverified
10Davinci (zero-shot)F1-score0.63—Unverified
#ModelMetricClaimedVerifiedStatus
1BERT-MRPAUROC0.86—Unverified
2BERT-RPAUROC0.85—Unverified
3BERT-HateXplain [LIME]AUROC0.85—Unverified
4BERT-HateXplain [Attn]AUROC0.85—Unverified
5BERT [Attn]AUROC0.84—Unverified
6BiRNN-HateXplain [Attn]AUROC0.81—Unverified
7BiRNN-Attn [Attn]AUROC0.8—Unverified
8CNN-GRU [LIME]AUROC0.79—Unverified
9BiRNN [LIME]AUROC0.77—Unverified
10XG-HSI-BERTAccuracy0.75—Unverified
#ModelMetricClaimedVerifiedStatus
1MLARAMHamming Loss0.29—Unverified
2MLkNNHamming Loss0.16—Unverified
3Binary RelevanceHamming Loss0.14—Unverified
4Neural Classifier ChainsHamming Loss0.13—Unverified
5Neural Binary RelevanceHamming Loss0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1Mozafari et al., 2019AAA50.94—Unverified
2SVMAAA46.51—Unverified
3Kennedy et al., 2020AAA45.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.74—Unverified
2BERTMacro F10.72—Unverified
#ModelMetricClaimedVerifiedStatus
1mBertAccuracy0.83—Unverified
2Logistic RegressionAccuracy0.7—Unverified
#ModelMetricClaimedVerifiedStatus
1HXP + CLAP + CLIPTEST F1 (macro)0.85—Unverified
2BERT + ViT + MFCCTEST F1 (macro)0.79—Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.49—Unverified
2BERTMacro F10.48—Unverified
#ModelMetricClaimedVerifiedStatus
1HateBERTMacro F10.81—Unverified
2BERTMacro F10.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Multilingual BERTF1-score0.75—Unverified
2AutoMLF1-score0.74—Unverified
#ModelMetricClaimedVerifiedStatus
1AOM mBERTF10.85—Unverified
#ModelMetricClaimedVerifiedStatus
1BaselineF10.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTa-large-STMacro F180.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Baseline BERT (task A)F10.77—Unverified