Semantic Role Labeling

Semantic role labeling aims to model the predicate-argument structure of a sentence and is often described as answering "Who did what to whom". BIO notation is typically used for semantic role labeling.

Example:

| Housing | starts | are | expected | to | quicken | a | bit | from | August’s | pace | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | B-ARG1 | I-ARG1 | O | O | O | V | B-ARG2 | I-ARG2 | B-ARG3 | I-ARG3 | I-ARG3 |

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 326–350 of 620 papers

Title	Date	Tasks	Status	Hype
A Unified Architecture for Semantic Role Labeling and Relation Classification	Dec 1, 2016	ClassificationFeature Engineering	—Unverified	0
Korean FrameNet Expansion Based on Projection of Japanese FrameNet	Dec 1, 2016	Machine TranslationReading Comprehension	—Unverified	0
K-SRL: Instance-based Learning for Semantic Role Labeling	Dec 1, 2016	Machine TranslationQuestion Answering	—Unverified	0
Langforia: Language Pipelines for Annotating Large Collections of Documents	Dec 1, 2016	ArticlesDependency Parsing	—Unverified	0
Better call Saul: Flexible Programming for Learning and Inference in NLP	Dec 1, 2016	Part-Of-Speech TaggingProbabilistic Programming	CodeCode Available	0
Modeling Context-sensitive Selectional Preference with Distributed Representations	Dec 1, 2016	Semantic Role Labeling	—Unverified	0
Multilingual Supervision of Semantic Annotation	Dec 1, 2016	Question AnsweringRelation Extraction	—Unverified	0
Parallel Sentence Compression	Dec 1, 2016	ArticlesMachine Translation	—Unverified	0
BioMedLAT Corpus: Annotation of the Lexical Answer Type for Biomedical Questions	Dec 1, 2016	Part-Of-Speech TaggingQuestion Answering	CodeCode Available	0
Negation and Modality in Machine Translation	Dec 1, 2016	Machine TranslationNegation	—Unverified	0
Visualizing the Content of a Children's Story in a Virtual World: Lessons Learned	Nov 1, 2016	Language ModelingLanguage Modelling	—Unverified	0
Statistical Script Learning with Recurrent Neural Networks	Nov 1, 2016	Coreference ResolutionQuestion Answering	—Unverified	0
A Study of Imitation Learning Methods for Semantic Role Labeling	Nov 1, 2016	Imitation LearningSemantic Role Labeling	—Unverified	0
Capturing Argument Relationship for Chinese Semantic Role Labeling	Nov 1, 2016	Chinese Semantic Role LabelingSemantic Role Labeling	—Unverified	0
Exploiting Mutual Benefits between Syntax and Semantic Roles using Neural Network	Nov 1, 2016	Dependency ParsingMulti-Task Learning	—Unverified	0
Event Detection and Co-reference with Minimal Supervision	Nov 1, 2016	Event DetectionSemantic Role Labeling	—Unverified	0
Neural Headline Generation on Abstract Meaning Representation	Nov 1, 2016	Abstract Meaning RepresentationDependency Parsing	—Unverified	0
Cross Sentence Inference for Process Knowledge	Nov 1, 2016	Semantic Role LabelingSentence	—Unverified	0
Computational linking theory	Oct 8, 2016	Semantic ParsingSemantic Role Labeling	—Unverified	0
Retrieval Term Prediction Using Deep Learning Methods	Oct 1, 2016	ChunkingDeep Learning	—Unverified	0
Recurrent Neural Network Based Loanwords Identification in Uyghur	Oct 1, 2016	Information RetrievalLanguage Modeling	—Unverified	0
Good Automatic Authentication Question Generation	Sep 1, 2016	Common Sense ReasoningDependency Parsing	—Unverified	0
An Incremental Parser for Abstract Meaning Representation	Aug 22, 2016	Abstract Meaning RepresentationAMR Parsing	CodeCode Available	1
Find the word that does not belong: A Framework for an Intrinsic Evaluation of Word Vector Representations	Aug 1, 2016	Machine TranslationOutlier Detection	—Unverified	0
Sentence Embedding Evaluation Using Pyramid Annotation	Aug 1, 2016	Natural Language InferenceSemantic Role Labeling	—Unverified	0

Show:10 25 50

← PrevPage 14 of 25Next →

All datasets OntoNotes CoNLL 2005 CoNLL05 Brown CoNLL05 WSJ CoNLL12 CoNLL-2009 CoNLL-2012

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	HeSyFu	F1	88.59	—	Unverified
2	CRF2o + RoBERTa	F1	88.32	—	Unverified
3	MRC-SRL	F1	88.3	—	Unverified
4	ReCAT(pretrained on wikitext103)	F1	88	—	Unverified
5	SRL-MM + XLNet	F1	87.67	—	Unverified
6	CRF2o + BERT	F1	87.66	—	Unverified
7	RoBERTa+RegCCRF	F1	87.51	—	Unverified
8	RoBERTa+CRF	F1	87.27	—	Unverified
9	BiLSTM-Span (Ensemble)	F1	87	—	Unverified
10	BiLSTM-Span	F1	86.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MRC-SRL	F1	90	—	Unverified
2	SRL-MM + XLNet	F1	89.8	—	Unverified
3	CRF2o + RoBERTa	F1	89.54	—	Unverified
4	HeSyFu	F1	89.04	—	Unverified
5	CRF2o + BERT	F1	89.03	—	Unverified
6	Mohammadshahi and Henderson (2021)	F1	88.93	—	Unverified
7	BiLSTM-Span (Ensemble, predicates given)	F1	88.5	—	Unverified
8	CRF2o	F1	87.87	—	Unverified
9	Li et al. (2019) (Ensemble)	F1	87.7	—	Unverified
10	BiLSTM-Span	F1	87.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DeepStruct multi-task w/ finetune	F1	92.1	—	Unverified
2	DeepStruct multi-task	F1	92	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DeepStruct multi-task	F1	95.5	—	Unverified
2	DeepStruct multi-task w/ finetune	F1	95.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DeepStruct multi-task	F1	97.2	—	Unverified
2	DeepStruct multi-task w/ finetune	F1	96	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Ours (High-Order model)	F1 (Arg.)	90.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HeSyFu	Avg. F1	88.59	—	Unverified