Linguistic Acceptability

Linguistic Acceptability is the task of determining whether a sentence is grammatical or ungrammatical.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 51–72 of 72 papers

Title	Date	Tasks	Status
General Cross-Architecture Distillation of Pretrained Language Models into Matrix Embeddings	Sep 17, 2021	CoLALinguistic Acceptability	CodeCode Available
An Automated Knowledge Mining and Document Classification System with Multi-model Transfer Learning	Jun 24, 2021	CoLADocument Classification	—Unverified
Using Integrated Gradients and Constituency Parse Trees to explain Linguistic Acceptability learnt by BERT	Jun 1, 2021	CoLADecision Making	—Unverified
Language Models Use Monotonicity to Assess NPI Licensing	May 28, 2021	DiagnosticLinguistic Acceptability	CodeCode Available
DaLAJ - a dataset for linguistic acceptability judgments for Swedish: Format, baseline, sharing	May 14, 2021	Binary ClassificationLinguistic Acceptability	—Unverified
DaLAJ – a dataset for linguistic acceptability judgments for Swedish	May 1, 2021	Linguistic Acceptability	—Unverified
CLEAR: Contrastive Learning for Sentence Representation	Dec 31, 2020	Contrastive LearningLinguistic Acceptability	—Unverified
Grammaticality and Language Modelling	Nov 1, 2020	CoLAExperimental Design	—Unverified
Domain Adversarial Fine-Tuning as an Effective Regularizer	Sep 28, 2020	Linguistic AcceptabilityNatural Language Understanding	CodeCode Available
SqueezeBERT: What can computer vision teach NLP about efficient neural networks?	Jun 19, 2020	Linguistic AcceptabilityNatural Language Inference	CodeCode Available
What Would Elsa Do? Freezing Layers During Transformer Fine-Tuning	Nov 8, 2019	Linguistic AcceptabilityNatural Language Inference	—Unverified
Natural Language Generation for Effective Knowledge Distillation	Nov 1, 2019	Knowledge DistillationLinguistic Acceptability	CodeCode Available
TinyBERT: Distilling BERT for Natural Language Understanding	Sep 23, 2019	Knowledge DistillationLanguage Modelling	CodeCode Available
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT	Sep 12, 2019	Linguistic AcceptabilityNatural Language Inference	—Unverified
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding	Aug 13, 2019	Language ModelingLanguage Modelling	—Unverified
SpanBERT: Improving Pre-training by Representing and Predicting Spans	Jul 24, 2019	Coreference ResolutionLinguistic Acceptability	CodeCode Available
ERNIE: Enhanced Language Representation with Informative Entities	May 17, 2019	Entity LinkingEntity Typing	CodeCode Available
Multi-Task Deep Neural Networks for Natural Language Understanding	Jan 31, 2019	Domain AdaptationLanguage Modeling	CodeCode Available
Linguistic Analysis of Pretrained Sentence Encoders with Acceptability Judgments	Jan 11, 2019	CoLAGeneral Classification	—Unverified
Grammatical Analysis of Pretrained Sentence Encoders with Acceptability Judgments	Dec 11, 2018	CoLALinguistic Acceptability	—Unverified
Rating Distributions and Bayesian Inference: Enhancing Cognitive Models of Spatial Language Use	Jul 1, 2018	Bayesian InferenceLinguistic Acceptability	—Unverified
Neural Network Acceptability Judgments	May 31, 2018	CoLAGeneral Classification	CodeCode Available

Show:10 25 50

← PrevPage 3 of 3Next →

All datasets CoLA RuCoLA CoLA Dev ItaCoLA DaLAJ

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	En-BERT + TDA + PCA	Accuracy	88.6	—	Unverified
2	BERT+TDA	Accuracy	88.2	—	Unverified
3	RoBERTa+TDA	Accuracy	87.3	—	Unverified
4	deberta-v3-base+tasksource	Accuracy	87.15	—	Unverified
5	RoBERTa-large 355M + Entailment as Few-shot Learner	Accuracy	86.4	—	Unverified
6	LTG-BERT-base 98M	Accuracy	82.7	—	Unverified
7	ELC-BERT-base 98M	Accuracy	82.6	—	Unverified
8	En-BERT + TDA	Accuracy	82.1	—	Unverified
9	FNet-Large	Accuracy	78	—	Unverified
10	LTG-BERT-small 24M	Accuracy	77.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Ru-RoBERTa+TDA	MCC	0.59	—	Unverified
2	ruRoBERTa	MCC	0.53	—	Unverified
3	Ru-BERT+TDA	MCC	0.48	—	Unverified
4	RemBERT	MCC	0.44	—	Unverified
5	ruBERT	MCC	0.42	—	Unverified
6	ruGPT-3	MCC	0.3	—	Unverified
7	ruT5	MCC	0.25	—	Unverified
8	mBERT	MCC	0.15	—	Unverified
9	XLM-R	MCC	0.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	En-BERT + TDA	Accuracy	88.6	—	Unverified
2	XLM-R (pre-trained) + TDA	Accuracy	73	—	Unverified
3	DeBERTa (large)	Accuracy	69.5	—	Unverified
4	TinyBERT-6 67M	Accuracy	54	—	Unverified
5	Synthesizer (R+V)	Accuracy	53.3	—	Unverified
6	En-BERT (pre-trained) + TDA	MCC	0.42	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	XLM-R + TDA	MCC	0.68	—	Unverified
2	XLM-R	MCC	0.52	—	Unverified
3	It-BERT (pre-trained) + TDA	MCC	0.48	—	Unverified
4	mBERT	MCC	0.36	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Sw-BERT + H0M	Accuracy	76.9	—	Unverified