Text Classification

Text Classification is the task of assigning a sentence or document an appropriate category. The categories depend on the chosen dataset and can range from topics.

Text Classification problems include emotion classification, news classification, citation intent classification, among others. Benchmark datasets for evaluating text classification capabilities include GLUE, AGNews, among others.

In recent years, deep learning techniques like XLNet and RoBERTa have attained some of the biggest performance jumps for text classification problems.

( Image credit: Text Classification Algorithms: A Survey )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 201–250 of 3635 papers

Title	Date	Tasks	Status	Hype
Augmenting Interpretable Models with LLMs during Training	Sep 23, 2022	Additive modelsLanguage Modelling	CodeCode Available	1
Cold-Start Data Selection for Few-shot Language Model Fine-tuning: A Prompt-Based Uncertainty Propagation Approach	Sep 15, 2022	DiversityLanguage Modeling	CodeCode Available	1
DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification	Sep 12, 2022	ClassificationData Augmentation	CodeCode Available	1
MaxMatch-Dropout: Subword Regularization for WordPiece	Sep 9, 2022	Machine TranslationText Classification	CodeCode Available	1
Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased Full Set Gradient Approximation	Aug 26, 2022	Point Cloud Classificationtext-classification	CodeCode Available	1
Prompting as Probing: Using Language Models for Knowledge Base Construction	Aug 23, 2022	Knowledge Base ConstructionLanguage Modeling	CodeCode Available	1
Correlation Networks for Extreme Multi-label Text Classification	Aug 23, 2022	ClassificationMulti Label Text Classification	CodeCode Available	1
Pre-training Tasks for User Intent Detection and Embedding Retrieval in E-commerce Search	Aug 12, 2022	CPUIntent Detection	CodeCode Available	1
Text Classification in Memristor-based Spiking Neural Networks	Jul 27, 2022	Classificationimage-classification	CodeCode Available	1
Embedding Recycling for Language Models	Jul 11, 2022	Question AnsweringText Classification	CodeCode Available	1
AcTune: Uncertainty-Based Active Self-Training for Active Fine-Tuning of Pretrained Language Models	Jul 1, 2022	Active Learningtext-classification	CodeCode Available	1
Thermodynamics-inspired Explanations of Artificial Intelligence	Jun 27, 2022	feature selectionimage-classification	CodeCode Available	1
Protoformer: Embedding Prototypes for Transformers	Jun 25, 2022	ClassificationGeneral Classification	CodeCode Available	1
Classifying Unstructured Clinical Notes via Automatic Weak Supervision	Jun 24, 2022	DiagnosticText Classification	CodeCode Available	1
ICS: Total Freedom in Manual Text Classification Supported by Unobtrusive Machine Learning	Jun 22, 2022	Active LearningClassification	CodeCode Available	1
Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data	Jun 20, 2022	ClassificationDomain Adaptation	CodeCode Available	1
Pretrained Models for Multilingual Federated Learning	Jun 6, 2022	Federated LearningLanguage Modeling	CodeCode Available	1
Annotation Error Detection: Analyzing the Past and Present for a More Coherent Future	Jun 5, 2022	text-classificationText Classification	CodeCode Available	1
InducT-GCN: Inductive Graph Convolutional Networks for Text Classification	Jun 1, 2022	ClassificationGraph Neural Network	CodeCode Available	1
kNN-Prompt: Nearest Neighbor Zero-Shot Inference	May 27, 2022	Domain AdaptationLanguage Modelling	CodeCode Available	1
A Sea of Words: An In-Depth Analysis of Anchors for Text Data	May 27, 2022	text-classificationText Classification	CodeCode Available	1
Self-Guided Noise-Free Data Generation for Efficient Zero-Shot Learning	May 25, 2022	text-classificationText Classification	CodeCode Available	1
Prompt Tuning for Discriminative Pre-trained Language Models	May 23, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
Weakly Supervised Text Classification using Supervision Signals from a Language Model	May 13, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
TreeMix: Compositional Constituency-based Data Augmentation for Natural Language Understanding	May 12, 2022	Constituency ParsingData Augmentation	CodeCode Available	1
Quantum Self-Attention Neural Networks for Text Classification	May 11, 2022	Classificationtext-classification	CodeCode Available	1
UL2: Unifying Language Learning Paradigms	May 10, 2022	Arithmetic ReasoningCommon Sense Reasoning	CodeCode Available	1
Towards Computationally Feasible Deep Active Learning	May 7, 2022	Active Learningtext-classification	CodeCode Available	1
Exploiting Global and Local Hierarchies for Hierarchical Text Classification	May 5, 2022	ClassificationMulti Label Text Classification	CodeCode Available	1
An Embarrassingly Simple Method to Mitigate Undesirable Properties of Pretrained Language Model Tokenizers	May 1, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
Learn to Adapt for Generalized Zero-Shot Text Classification	May 1, 2022	ClassificationGeneralized Zero-Shot Learning	CodeCode Available	1
AMR-DA: Data Augmentation by Abstract Meaning Representation	May 1, 2022	Abstract Meaning RepresentationData Augmentation	CodeCode Available	1
Flooding-X: Improving BERT’s Resistance to Adversarial Attacks via Loss-Restricted Fine-Tuning	May 1, 2022	Adversarial Robustnesstext-classification	CodeCode Available	1
HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification	Apr 28, 2022	ClassificationLanguage Modeling	CodeCode Available	1
EPiDA: An Easy Plug-in Data Augmentation Framework for High Performance Text Classification	Apr 24, 2022	Data AugmentationDiversity	CodeCode Available	1
Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification	Apr 20, 2022	Learning with noisy labelstext-classification	CodeCode Available	1
Revisiting Transformer-based Models for Long Document Classification	Apr 14, 2022	ClassificationDocument Classification	CodeCode Available	1
Label Semantic Aware Pre-training for Few-shot Text Classification	Apr 14, 2022	ClassificationFew-Shot Text Classification	CodeCode Available	1
Distributionally Robust Models with Parametric Likelihood Ratios	Apr 13, 2022	text-classificationText Classification	CodeCode Available	1
Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification	Apr 13, 2022	Few-Shot Text ClassificationLanguage Modeling	CodeCode Available	1
Are We Really Making Much Progress in Text Classification? A Comparative Review	Apr 8, 2022	ClassificationDecoder	CodeCode Available	1
RuBioRoBERTa: a pre-trained biomedical language model for Russian language biomedical text mining	Apr 8, 2022	Language ModelingLanguage Modelling	CodeCode Available	1
Understanding Graph Convolutional Networks for Text Classification	Mar 30, 2022	Classificationgraph construction	CodeCode Available	1
Few-Shot Learning with Siamese Networks and Label Tuning	Mar 28, 2022	Few-Shot LearningFew-Shot Text Classification	CodeCode Available	1
Cluster & Tune: Boost Cold Start Performance in Text Classification	Mar 20, 2022	ClassificationClustering	CodeCode Available	1
On Robust Prefix-Tuning for Text Classification	Mar 19, 2022	ClassificationLanguage Modelling	CodeCode Available	1
MarkBERT: Marking Word Boundaries Improves Chinese BERT	Mar 12, 2022	Chinese Named Entity Recognitionnamed-entity-recognition	CodeCode Available	1
Pretrained Domain-Specific Language Model for General Information Retrieval Tasks in the AEC Domain	Mar 9, 2022	Information RetrievalLanguage Modeling	CodeCode Available	1
Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification	Mar 8, 2022	ClassificationContrastive Learning	CodeCode Available	1
Text Smoothing: Enhance Various Data Augmentation Methods on Text Classification Tasks	Feb 28, 2022	Data AugmentationLanguage Modeling	CodeCode Available	1

Show:10 25 50

← PrevPage 5 of 73Next →

All datasets MTEB AG News DBpedia R8 TREC-6 20NEWS UK Key Stage Readability Ohsumed Yahoo! Answers MR Climabench NewsDiscourse

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ST5-XXL	Accuracy	73.42	—	Unverified
2	ST5-XL	Accuracy	72.84	—	Unverified
3	ST5-Large	Accuracy	72.31	—	Unverified
4	Ada Similarity	Accuracy	70.44	—	Unverified
5	SGPT-5.8B-nli	Accuracy	70.14	—	Unverified
6	ST5-Base	Accuracy	69.81	—	Unverified
7	SGPT-5.8B-msmarco	Accuracy	68.13	—	Unverified
8	MPNet-multilingual	Accuracy	67.91	—	Unverified
9	GTR-XXL	Accuracy	67.41	—	Unverified
10	SimCSE-BERT-sup	Accuracy	67.32	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Mistral-Small-24B + CAPO	Error	15.7	—	Unverified
2	ToWE-SG	Error	14	—	Unverified
3	Qwen2.5-32B + CAPO	Error	12.93	—	Unverified
4	Llama-3.3-70B + CAPO	Error	11.2	—	Unverified
5	Seq2CNN with GWS(50)	Error	9.64	—	Unverified
6	Char-level CNN	Error	9.51	—	Unverified
7	SVDCNN	Error	9.45	—	Unverified
8	VDCN	Error	8.67	—	Unverified
9	Balanced+bi-leaf-RNN	Error	7.9	—	Unverified
10	CCCapsNet	Error	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Seq2CNN(50)	Error	2.77	—	Unverified
2	Char-level CNN	Error	1.55	—	Unverified
3	SWEM-concat	Error	1.43	—	Unverified
4	FastText	Error	1.4	—	Unverified
5	VDCN	Error	1.29	—	Unverified
6	CCCapsNet	Error	1.28	—	Unverified
7	Balanced+bi-leaf-RNN	Error	1.2	—	Unverified
8	BERT large UDA	Error	1.09	—	Unverified
9	M-ACNN	Error	1.07	—	Unverified
10	EXAM	Error	1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DeBERTa	Accuracy	98.45	—	Unverified
2	C-BERT (ESGNN + BERT)	Accuracy	98.28	—	Unverified
3	ESGNN	Accuracy	98.23	—	Unverified
4	RoBERTaGCN	Accuracy	98.2	—	Unverified
5	BERT	Accuracy	98.17	—	Unverified
6	SGNN	Accuracy	98.09	—	Unverified
7	ERNIE 2.0	Accuracy	98.04	—	Unverified
8	DistilBERT	Accuracy	97.98	—	Unverified
9	Our Model*	Accuracy	97.8	—	Unverified
10	ALBERTv2	Accuracy	97.62	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TM-Glove	Error	9.96	—	Unverified
2	byte mLSTM7	Error	9.6	—	Unverified
3	SWEM-aver	Error	7.8	—	Unverified
4	DELTA (CNN)	Error	7.8	—	Unverified
5	Capsule-B	Error	7.2	—	Unverified
6	STM+TSED+PT+2L	Error	7.04	—	Unverified
7	GRU-RNN-GLOVE	Error	7	—	Unverified
8	MPAD-path	Error	6.2	—	Unverified
9	VLAWE	Error	5.8	—	Unverified
10	C-LSTM	Error	5.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LinearSVM+TFIDF	Accuracy	93	—	Unverified
2	RoBERTaGCN	Accuracy	89.5	—	Unverified
3	SSGC	Accuracy	88.6	—	Unverified
4	SGC	Accuracy	88.5	—	Unverified
5	SGCN	Accuracy	88.5	—	Unverified
6	RMDL (15 RDLs)	Accuracy	87.91	—	Unverified
7	Sparse Tensor Classifier	Accuracy	87.3	—	Unverified
8	GraphStar	Accuracy	86.9	—	Unverified
9	NABoE-full	Accuracy	86.8	—	Unverified
10	Text GCN	Accuracy	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ELECTRA + ANN	F1	99.6	—	Unverified
2	ERNIE + ANN	F1	99.4	—	Unverified
3	XLNet + ANN	F1	99.2	—	Unverified
4	RoBERTa + ANN	F1	98.7	—	Unverified
5	Longformer + ANN	F1	93.9	—	Unverified
6	BERT + ANN	F1	90.5	—	Unverified
7	ALBERT + ANN	F1	79.7	—	Unverified
8	BERT	F1	75	—	Unverified
9	DistilBERT	F1	74.4	—	Unverified
10	XLNet	F1	74	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RoBERTaGCN	Accuracy	72.8	—	Unverified
2	Our Model*	Accuracy	69.4	—	Unverified
3	SSGC	Accuracy	68.5	—	Unverified
4	SGC	Accuracy	68.5	—	Unverified
5	SGCN	Accuracy	68.5	—	Unverified
6	Text GCN	Accuracy	68.36	—	Unverified
7	GraphStar	Accuracy	64.2	—	Unverified
8	ApproxRepSet	Accuracy	64.06	—	Unverified
9	REL-RWMD k-NN	Accuracy	58.74	—	Unverified
10	CNN+Lowercased	Accuracy	36.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	BERT-ITPT-FiT	Accuracy	77.62	—	Unverified
2	DRNN	Accuracy	76.26	—	Unverified
3	DELTA (HAN)	Accuracy	75.1	—	Unverified
4	EXAM	Accuracy	74.8	—	Unverified
5	DNC+CUW	Accuracy	74.3	—	Unverified
6	ULMFiT (Small data)	Accuracy	74.3	—	Unverified
7	CCCapsNet	Accuracy	73.85	—	Unverified
8	SWEM-concat	Accuracy	73.53	—	Unverified
9	FastText	Accuracy	72.3	—	Unverified
10	Seq2CNN(50)	Accuracy	55.39	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DeBERTa	Accuracy	90.21	—	Unverified
2	RoBERTaGCN	Accuracy	89.7	—	Unverified
3	ERNIE 2.0 (optimized)	Accuracy	89.53	—	Unverified
4	RoBERTa	Accuracy	89.42	—	Unverified
5	ERNIE 2.0	Accuracy	88.97	—	Unverified
6	BERT	Accuracy	86.94	—	Unverified
7	ALBERTv2	Accuracy	86.02	—	Unverified
8	DistilBERT	Accuracy	85.31	—	Unverified
9	SSGC	Accuracy	76.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CliReBERT (P0L3/clirebert_clirevocab_uncased)	Evaluation Macro F1	0.65	—	Unverified
2	ClimateBERT (climatebert/distilroberta-base-climate-f)	Evaluation Macro F1	0.64	—	Unverified
3	BERT (google-bert/bert-base-uncased)	Evaluation Macro F1	0.61	—	Unverified
4	CliSciBERT (P0L3/cliscibert_scivocab_uncased)	Evaluation Macro F1	0.61	—	Unverified
5	SciBERT (allenai/scibert_scivocab_cased)	Evaluation Macro F1	0.59	—	Unverified
6	DistilRoBERTa (distilbert/distilroberta-base)	Evaluation Macro F1	0.58	—	Unverified
7	SciClimateBERT (P0L3/sciclimatebert)	Evaluation Macro F1	0.58	—	Unverified
8	RoBERTa (FacebookAI/roberta-base)	Evaluation Macro F1	0.57	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Human (Post-Rec.) (Spangher et al., 2021)	macro F1	73.69	—	Unverified
2	MT-Mac (Spangher et al., 2021)	macro F1	63.46	—	Unverified
3	MT-Mic (Spangher et al., 2021)	macro F1	61.89	—	Unverified
4	RL-IP/TT (Choubey et al., 2021)	macro F1	57	—	Unverified
5	Document LSTM + Document encoding (Choubey et al., 2020)	macro F1	54.4	—	Unverified
6	CRF Fine-grained (Choubey et al., 2020)	macro F1	52.9	—	Unverified
7	Human (Blind) (Spangher et al., 2021)	macro F1	46.18	—	Unverified
8	Feature-based (SVM) (Choubey et al., 2020)	macro F1	38.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	1-6 BertGCN	Accuracy	96.6	—	Unverified
2	GraphStar	Accuracy	95	—	Unverified
3	Our Model*	Accuracy	94.6	—	Unverified
4	SSGC	Accuracy	94.5	—	Unverified
5	SGC	Accuracy	94	—	Unverified
6	SGCN	Accuracy	94	—	Unverified
7	Text GCN	Accuracy	93.56	—	Unverified
8	TM-Glove	Accuracy	89.14	—	Unverified