Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 301–318 of 318 papers

Title	Date	Tasks	Status
Exploring Context and Visual Pattern of Relationship for Scene Graph Generation	Jun 1, 2019	DiversityGraph Generation	—Unverified
Contextual Translation Embedding for Visual Relationship Detection and Scene Graph Generation	May 28, 2019	Graph GenerationObject	—Unverified
Target-Tailored Source-Transformation for Scene Graph Generation	Apr 3, 2019	graph constructionGraph Generation	—Unverified
Scene Graph Generation with External Knowledge and Image Reconstruction	Apr 1, 2019	Graph GenerationImage Reconstruction	—Unverified
Visual Semantic Information Pursuit: A Survey	Mar 13, 2019	Graph Generationobject-detection	—Unverified
VrR-VG: Refocusing Visually-Relevant Relationships	Feb 1, 2019	Image CaptioningQuestion Answering	—Unverified
Counterfactual Critic Multi-Agent Training for Scene Graph Generation	Dec 6, 2018	counterfactualGraph Generation	—Unverified
Attentive Relational Networks for Mapping Images to Scene Graphs	Nov 26, 2018	Graph GenerationObject	—Unverified
An Interpretable Model for Scene Graph Generation	Nov 21, 2018	Graph GenerationImage Captioning	—Unverified
Scene Graph Generation via Conditional Random Fields	Nov 20, 2018	Graph GenerationImage Retrieval	—Unverified
LinkNet: Relational Embedding for Scene Graph	Nov 15, 2018	Graph GenerationScene Graph Generation	CodeCode Available
Image-Level Attentional Context Modeling Using Nested-Graph Neural Networks	Nov 9, 2018	Graph GenerationGraph Neural Network	—Unverified
Factorizable Net: An Efficient Subgraph-based Framework for Scene Graph Generation	Jun 29, 2018	ClusteringGraph Generation	CodeCode Available
Approximate Query Matching for Image Retrieval	Mar 14, 2018	Graph GenerationImage Retrieval	—Unverified
Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction	Feb 15, 2018	Scene Graph ClassificationScene Graph Generation	CodeCode Available
Generating Triples with Adversarial Networks for Scene Graph Construction	Feb 7, 2018	Attributegraph construction	—Unverified
Scene Graph Generation from Objects, Phrases and Region Captions	Jul 31, 2017	Graph Generationobject-detection	CodeCode Available
Pixels to Graphs by Associative Embedding	Jun 22, 2017	Graph GenerationScene Graph Generation	CodeCode Available

Show:10 25 50

← PrevPage 7 of 7Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified