SOTAVerified

Text Classification

Text Classification is the task of assigning a sentence or document an appropriate category. The categories depend on the chosen dataset and can range from topics.

Text Classification problems include emotion classification, news classification, citation intent classification, among others. Benchmark datasets for evaluating text classification capabilities include GLUE, AGNews, among others.

In recent years, deep learning techniques like XLNet and RoBERTa have attained some of the biggest performance jumps for text classification problems.

( Image credit: Text Classification Algorithms: A Survey )

Papers

Showing 1–25 of 3635 papers

TitleStatusHype
SWIFT:A Scalable lightWeight Infrastructure for Fine-TuningCode11
AutoTrain: No-code training for state-of-the-art modelsCode7
FourierKAN outperforms MLP on Text Classification Head Fine-tuningCode7
Interactive Prompt Debugging with Sequence SalienceCode7
h2oGPT: Democratizing Large Language ModelsCode6
ChatGPT Outperforms Crowd-Workers for Text-Annotation TasksCode4
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice PerspectiveCode4
MTEB: Massive Text Embedding BenchmarkCode4
N-Grammer: Augmenting Transformers with latent n-gramsCode4
BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language ModelsCode3
FusionBench: A Comprehensive Benchmark of Deep Model FusionCode3
Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation DatasetCode3
MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of ExpertsCode3
When LLMs are Unfit Use FastFit: Fast and Effective Text Classification with Many ClassesCode3
A Survey of Large Language Models in Finance (FinLLMs)Code3
PyABSA: A Modularized Framework for Reproducible Aspect-based Sentiment AnalysisCode3
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language ModelsCode3
Personalized Benchmarking with the Ludwig Benchmarking ToolkitCode3
RoFormer: Enhanced Transformer with Rotary Position EmbeddingCode3
Ludwig: a type-based declarative deep learning toolboxCode3
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingCode3
Universal Language Model Fine-tuning for Text ClassificationCode3
PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical AbstractsCode3
CAPO: Cost-Aware Prompt OptimizationCode2
In Defense of Lazy Visual Grounding for Open-Vocabulary Semantic SegmentationCode2
Show:102550
← PrevPage 1 of 146Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ST5-XXLAccuracy73.42—Unverified
2ST5-XLAccuracy72.84—Unverified
3ST5-LargeAccuracy72.31—Unverified
4Ada SimilarityAccuracy70.44—Unverified
5SGPT-5.8B-nliAccuracy70.14—Unverified
6ST5-BaseAccuracy69.81—Unverified
7SGPT-5.8B-msmarcoAccuracy68.13—Unverified
8MPNet-multilingualAccuracy67.91—Unverified
9GTR-XXLAccuracy67.41—Unverified
10SimCSE-BERT-supAccuracy67.32—Unverified
#ModelMetricClaimedVerifiedStatus
1Mistral-Small-24B + CAPOError15.7—Unverified
2ToWE-SGError14—Unverified
3Qwen2.5-32B + CAPOError12.93—Unverified
4Llama-3.3-70B + CAPOError11.2—Unverified
5Seq2CNN with GWS(50)Error9.64—Unverified
6Char-level CNNError9.51—Unverified
7SVDCNNError9.45—Unverified
8VDCNError8.67—Unverified
9Balanced+bi-leaf-RNNError7.9—Unverified
10CCCapsNetError7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1Seq2CNN(50)Error2.77—Unverified
2Char-level CNNError1.55—Unverified
3SWEM-concatError1.43—Unverified
4FastTextError1.4—Unverified
5VDCNError1.29—Unverified
6CCCapsNetError1.28—Unverified
7Balanced+bi-leaf-RNNError1.2—Unverified
8BERT large UDAError1.09—Unverified
9M-ACNNError1.07—Unverified
10EXAMError1—Unverified
#ModelMetricClaimedVerifiedStatus
1DeBERTaAccuracy98.45—Unverified
2C-BERT (ESGNN + BERT)Accuracy98.28—Unverified
3ESGNNAccuracy98.23—Unverified
4RoBERTaGCNAccuracy98.2—Unverified
5BERTAccuracy98.17—Unverified
6SGNNAccuracy98.09—Unverified
7ERNIE 2.0Accuracy98.04—Unverified
8DistilBERTAccuracy97.98—Unverified
9Our Model*Accuracy97.8—Unverified
10ALBERTv2Accuracy97.62—Unverified
#ModelMetricClaimedVerifiedStatus
1TM-GloveError9.96—Unverified
2byte mLSTM7Error9.6—Unverified
3DELTA (CNN)Error7.8—Unverified
4SWEM-averError7.8—Unverified
5Capsule-BError7.2—Unverified
6STM+TSED+PT+2LError7.04—Unverified
7GRU-RNN-GLOVEError7—Unverified
8MPAD-pathError6.2—Unverified
9VLAWEError5.8—Unverified
10C-LSTMError5.4—Unverified
#ModelMetricClaimedVerifiedStatus
1LinearSVM+TFIDFAccuracy93—Unverified
2RoBERTaGCNAccuracy89.5—Unverified
3SSGCAccuracy88.6—Unverified
4SGCAccuracy88.5—Unverified
5SGCNAccuracy88.5—Unverified
6RMDL (15 RDLs)Accuracy87.91—Unverified
7Sparse Tensor ClassifierAccuracy87.3—Unverified
8GraphStarAccuracy86.9—Unverified
9NABoE-fullAccuracy86.8—Unverified
10Text GCNAccuracy86.34—Unverified
#ModelMetricClaimedVerifiedStatus
1ELECTRA + ANNF199.6—Unverified
2ERNIE + ANNF199.4—Unverified
3XLNet + ANNF199.2—Unverified
4RoBERTa + ANNF198.7—Unverified
5Longformer + ANNF193.9—Unverified
6BERT + ANNF190.5—Unverified
7ALBERT + ANNF179.7—Unverified
8BERTF175—Unverified
9DistilBERTF174.4—Unverified
10LongformerF174—Unverified
#ModelMetricClaimedVerifiedStatus
1RoBERTaGCNAccuracy72.8—Unverified
2Our Model*Accuracy69.4—Unverified
3SGCNAccuracy68.5—Unverified
4SGCAccuracy68.5—Unverified
5SSGCAccuracy68.5—Unverified
6Text GCNAccuracy68.36—Unverified
7GraphStarAccuracy64.2—Unverified
8ApproxRepSetAccuracy64.06—Unverified
9REL-RWMD k-NNAccuracy58.74—Unverified
10CNN+LowercasedAccuracy36.2—Unverified
#ModelMetricClaimedVerifiedStatus
1BERT-ITPT-FiTAccuracy77.62—Unverified
2DRNNAccuracy76.26—Unverified
3DELTA (HAN)Accuracy75.1—Unverified
4EXAMAccuracy74.8—Unverified
5DNC+CUWAccuracy74.3—Unverified
6ULMFiT (Small data)Accuracy74.3—Unverified
7CCCapsNetAccuracy73.85—Unverified
8SWEM-concatAccuracy73.53—Unverified
9FastTextAccuracy72.3—Unverified
10Seq2CNN(50)Accuracy55.39—Unverified
#ModelMetricClaimedVerifiedStatus
1DeBERTaAccuracy90.21—Unverified
2RoBERTaGCNAccuracy89.7—Unverified
3ERNIE 2.0 (optimized)Accuracy89.53—Unverified
4RoBERTaAccuracy89.42—Unverified
5ERNIE 2.0Accuracy88.97—Unverified
6BERTAccuracy86.94—Unverified
7ALBERTv2Accuracy86.02—Unverified
8DistilBERTAccuracy85.31—Unverified
9SSGCAccuracy76.7—Unverified
#ModelMetricClaimedVerifiedStatus
1CliReBERT (P0L3/clirebert_clirevocab_uncased)Evaluation Macro F10.65—Unverified
2ClimateBERT (climatebert/distilroberta-base-climate-f)Evaluation Macro F10.64—Unverified
3BERT (google-bert/bert-base-uncased)Evaluation Macro F10.61—Unverified
4CliSciBERT (P0L3/cliscibert_scivocab_uncased)Evaluation Macro F10.61—Unverified
5SciBERT (allenai/scibert_scivocab_cased)Evaluation Macro F10.59—Unverified
6DistilRoBERTa (distilbert/distilroberta-base)Evaluation Macro F10.58—Unverified
7SciClimateBERT (P0L3/sciclimatebert)Evaluation Macro F10.58—Unverified
8RoBERTa (FacebookAI/roberta-base)Evaluation Macro F10.57—Unverified
#ModelMetricClaimedVerifiedStatus
1Human (Post-Rec.) (Spangher et al., 2021)macro F173.69—Unverified
2MT-Mac (Spangher et al., 2021)macro F163.46—Unverified
3MT-Mic (Spangher et al., 2021)macro F161.89—Unverified
4RL-IP/TT (Choubey et al., 2021)macro F157—Unverified
5Document LSTM + Document encoding (Choubey et al., 2020)macro F154.4—Unverified
6CRF Fine-grained (Choubey et al., 2020)macro F152.9—Unverified
7Human (Blind) (Spangher et al., 2021)macro F146.18—Unverified
8Feature-based (SVM) (Choubey et al., 2020)macro F138.3—Unverified
#ModelMetricClaimedVerifiedStatus
11-6 BertGCNAccuracy96.6—Unverified
2GraphStarAccuracy95—Unverified
3Our Model*Accuracy94.6—Unverified
4SSGCAccuracy94.5—Unverified
5SGCNAccuracy94—Unverified
6SGCAccuracy94—Unverified
7Text GCNAccuracy93.56—Unverified
8TM-GloveAccuracy89.14—Unverified