Hate Speech Detection

Hate speech detection is the task of detecting if communication such as text, audio, and so on contains hatred and or encourages violence towards a person or a group of people. This is usually based on prejudice against 'protected characteristics' such as their ethnicity, gender, sexual orientation, religion, age et al. Some example benchmarks are ETHOS and HateXplain. Models can be evaluated with metrics like the F-score or F-measure.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 26–50 of 507 papers

Title	Date	Tasks	Status	Hype	Score
Enhancing social network hate detection using back translation and GPT-3 augmentations during training and test-time	Jun 17, 2023	Hate Speech Detection	CodeCode Available	1	5
Detecting Hate Speech with GPT-3	Mar 23, 2021	Few-Shot LearningHate Speech Detection	CodeCode Available	1	5
Deep Learning Models for Multilingual Hate Speech Detection	Apr 14, 2020	Deep LearningHate Speech Detection	CodeCode Available	1	5
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter	Oct 2, 2019	Hate Speech DetectionKnowledge Distillation	CodeCode Available	1	5
Detecting Hate Speech in Multi-modal Memes	Dec 29, 2020	Binary ClassificationHate Speech Detection	CodeCode Available	1	5
Enhancing Social Network Hate Detection Using Back Translation and GPT-3 Augmentations During Training and Test-Time	Jun 13, 2023	Hate Speech DetectionHate Speech Normalization	CodeCode Available	1	5
Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarks	May 8, 2023	Hate Speech Detection	CodeCode Available	1	5
Aggression and Misogyny Detection using BERT: A Multi-Task Approach	May 1, 2020	Abusive LanguageAggression Identification	CodeCode Available	1	5
Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists	Mar 17, 2022	Abuse DetectionBias Detection	CodeCode Available	1	5
A Comprehensive Dataset for German Offensive Language and Conversation Analysis	Jul 1, 2022	Hate Speech Detection	CodeCode Available	1	5
HateCheck: Functional Tests for Hate Speech Detection Models	Dec 31, 2020	DiagnosticHate Speech Detection	CodeCode Available	1	5
BEEP! Korean Corpus of Online News Comments for Toxic Speech Detection	May 26, 2020	Hate Speech Detection	CodeCode Available	1	5
Generalizable Implicit Hate Speech Detection Using Contrastive Learning	Oct 1, 2022	Contrastive LearningHate Speech Detection	CodeCode Available	1	5
Comparative Studies of Detecting Abusive Language on Twitter	Aug 30, 2018	Abuse DetectionAbusive Language	CodeCode Available	1	5
HateMM: A Multi-Modal Dataset for Hate Video Classification	May 6, 2023	ClassificationHate Speech Detection	CodeCode Available	1	5
A Large-scale Dataset for Hate Speech Detection on Vietnamese Social Media Texts	Mar 22, 2021	Hate Speech DetectionVietnamese Hate Speech Detection	CodeCode Available	1	5
HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection	Dec 18, 2020	Hate Speech DetectionText Classification	CodeCode Available	1	5
APEACH: Attacking Pejorative Expressions with Analysis on Crowd-Generated Hate Speech Evaluation Datasets	Feb 25, 2022	Hate Speech Detection	CodeCode Available	1	5
Classification Benchmarks for Under-resourced Bengali Language based on Multichannel Convolutional-LSTM Network	Apr 11, 2020	ArticlesClassification	CodeCode Available	1	5
AraCOVID19-MFH: Arabic COVID-19 Multi-label Fake News and Hate Speech Detection Dataset	May 7, 2021	ArticlesDialect Identification	CodeCode Available	1	5
CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean	Mar 11, 2024	Hate Speech Detection	CodeCode Available	1	5
Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection	Dec 31, 2020	Hate Speech Detection	CodeCode Available	1	5
MultiHateClip: A Multilingual Benchmark Dataset for Hateful Video Detection on YouTube and Bilibili	Jul 28, 2024	Hate Speech DetectionVideo Classification	CodeCode Available	1	5
Multilingual Twitter Corpus and Baselines for Evaluating Demographic Bias in Hate Speech Recognition	Feb 24, 2020	Document ClassificationFairness	CodeCode Available	1	5
Why Is It Hate Speech? Masked Rationale Prediction for Explainable Hate Speech Detection	Nov 1, 2022	Hate Speech DetectionSentence	CodeCode Available	1	5

Show:10 25 50

← PrevPage 2 of 21Next →

All datasets Ethos Binary HateXplain Ethos MultiLabel Waseem et al., 2018 AbusEval Automatic Misogynistic Identification HateMM HatEval OffensEval 2019 ToLD-Br bajer_danish_misogyny DKhate

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	BiLSTM + static BE	F1-score	0.8	—	Unverified
2	BERT	F1-score	0.79	—	Unverified
3	BiLSTM+Attention+FT	F1-score	0.77	—	Unverified
4	OPT-175B (few-shot)	F1-score	0.76	—	Unverified
5	CNN+Attention+FT+GV	F1-score	0.74	—	Unverified
6	OPT-175B (one-shot)	F1-score	0.71	—	Unverified
7	OPT-175B (zero-shot)	F1-score	0.67	—	Unverified
8	SVM	F1-score	0.66	—	Unverified
9	Random Forests	F1-score	0.64	—	Unverified
10	Davinci (zero-shot)	F1-score	0.63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BERT-MRP	AUROC	0.86	—	Unverified
2	BERT-RP	AUROC	0.85	—	Unverified
3	BERT-HateXplain [LIME]	AUROC	0.85	—	Unverified
4	BERT-HateXplain [Attn]	AUROC	0.85	—	Unverified
5	BERT [Attn]	AUROC	0.84	—	Unverified
6	BiRNN-HateXplain [Attn]	AUROC	0.81	—	Unverified
7	BiRNN-Attn [Attn]	AUROC	0.8	—	Unverified
8	CNN-GRU [LIME]	AUROC	0.79	—	Unverified
9	BiRNN [LIME]	AUROC	0.77	—	Unverified
10	XG-HSI-BERT	Accuracy	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLARAM	Hamming Loss	0.29	—	Unverified
2	MLkNN	Hamming Loss	0.16	—	Unverified
3	Binary Relevance	Hamming Loss	0.14	—	Unverified
4	Neural Classifier Chains	Hamming Loss	0.13	—	Unverified
5	Neural Binary Relevance	Hamming Loss	0.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Mozafari et al., 2019	AAA	50.94	—	Unverified
2	SVM	AAA	46.51	—	Unverified
3	Kennedy et al., 2020	AAA	45.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HateBERT	Macro F1	0.74	—	Unverified
2	BERT	Macro F1	0.72	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	mBert	Accuracy	0.83	—	Unverified
2	Logistic Regression	Accuracy	0.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HXP + CLAP + CLIP	TEST F1 (macro)	0.85	—	Unverified
2	BERT + ViT + MFCC	TEST F1 (macro)	0.79	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HateBERT	Macro F1	0.49	—	Unverified
2	BERT	Macro F1	0.48	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HateBERT	Macro F1	0.81	—	Unverified
2	BERT	Macro F1	0.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Multilingual BERT	F1-score	0.75	—	Unverified
2	AutoML	F1-score	0.74	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AOM mBERT	F1	0.85	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Baseline	F1	0.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RoBERTa-large-ST	Macro F1	80.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Baseline BERT (task A)	F1	0.77	—	Unverified