Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 301–318 of 318 papers

Title	Date	Tasks	Status	Hype
Graphical Contrastive Losses for Scene Graph Parsing	Mar 7, 2019	Relationship DetectionScene Graph Generation	CodeCode Available	1
VrR-VG: Refocusing Visually-Relevant Relationships	Feb 1, 2019	Image CaptioningQuestion Answering	—Unverified	0
Counterfactual Critic Multi-Agent Training for Scene Graph Generation	Dec 6, 2018	counterfactualGraph Generation	—Unverified	0
Learning to Compose Dynamic Tree Structures for Visual Contexts	Dec 5, 2018	Graph GenerationPanoptic Scene Graph Generation	CodeCode Available	2
Attentive Relational Networks for Mapping Images to Scene Graphs	Nov 26, 2018	Graph GenerationObject	—Unverified	0
An Interpretable Model for Scene Graph Generation	Nov 21, 2018	Graph GenerationImage Captioning	—Unverified	0
Scene Graph Generation via Conditional Random Fields	Nov 20, 2018	Graph GenerationImage Retrieval	—Unverified	0
LinkNet: Relational Embedding for Scene Graph	Nov 15, 2018	Graph GenerationScene Graph Generation	CodeCode Available	0
Image-Level Attentional Context Modeling Using Nested-Graph Neural Networks	Nov 9, 2018	Graph GenerationGraph Neural Network	—Unverified	0
Graph R-CNN for Scene Graph Generation	Aug 1, 2018	Graph GenerationScene Graph Generation	CodeCode Available	1
Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning	Jul 16, 2018	3d scene graph generationGraph Generation	CodeCode Available	1
Factorizable Net: An Efficient Subgraph-based Framework for Scene Graph Generation	Jun 29, 2018	ClusteringGraph Generation	CodeCode Available	0
Approximate Query Matching for Image Retrieval	Mar 14, 2018	Graph GenerationImage Retrieval	—Unverified	0
Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction	Feb 15, 2018	Scene Graph ClassificationScene Graph Generation	CodeCode Available	0
Generating Triples with Adversarial Networks for Scene Graph Construction	Feb 7, 2018	Attributegraph construction	—Unverified	0
Scene Graph Generation from Objects, Phrases and Region Captions	Jul 31, 2017	Graph Generationobject-detection	CodeCode Available	0
Pixels to Graphs by Associative Embedding	Jun 22, 2017	Graph GenerationScene Graph Generation	CodeCode Available	0
Scene Graph Generation by Iterative Message Passing	Jan 10, 2017	Graph GenerationPanoptic Scene Graph Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 7 of 7Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified