Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 311–318 of 318 papers

Title	Date	Tasks	Status	Hype
Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning	Jul 16, 2018	3d scene graph generationGraph Generation	CodeCode Available	1
Factorizable Net: An Efficient Subgraph-based Framework for Scene Graph Generation	Jun 29, 2018	ClusteringGraph Generation	CodeCode Available	0
Approximate Query Matching for Image Retrieval	Mar 14, 2018	Graph GenerationImage Retrieval	—Unverified	0
Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction	Feb 15, 2018	Scene Graph ClassificationScene Graph Generation	CodeCode Available	0
Generating Triples with Adversarial Networks for Scene Graph Construction	Feb 7, 2018	Attributegraph construction	—Unverified	0
Scene Graph Generation from Objects, Phrases and Region Captions	Jul 31, 2017	Graph Generationobject-detection	CodeCode Available	0
Pixels to Graphs by Associative Embedding	Jun 22, 2017	Graph GenerationScene Graph Generation	CodeCode Available	0
Scene Graph Generation by Iterative Message Passing	Jan 10, 2017	Graph GenerationPanoptic Scene Graph Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 32 of 32Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified