Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 276–300 of 318 papers

Title	Date	Tasks	Status	Hype
Assisting Scene Graph Generation with Self-Supervision	Aug 8, 2020	Graph GenerationImage Captioning	—Unverified	0
Sketching Image Gist: Human-Mimetic Hierarchical Scene Graph Generation	Jul 17, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1
Generative Compositional Augmentations for Scene Graph Prediction	Jul 11, 2020	Graph GenerationLanguage Modelling	CodeCode Available	1
Learning and Reasoning with the Graph Structure Representation in Robotic Surgery	Jul 7, 2020	Edge ClassificationGraph Generation	CodeCode Available	1
Neuro-Symbolic Visual Reasoning: Disentangling "Visual" from "Reasoning"	Jun 20, 2020	Graph GenerationQuestion Answering	—Unverified	0
Learning Visual Commonsense for Robust Scene Graph Generation	Jun 17, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1
Learning from the Scene and Borrowing from the Rich: Tackling the Long Tail in Scene Graph Generation	Jun 13, 2020	Graph GenerationObject	—Unverified	0
Graph Density-Aware Losses for Novel Compositions in Scene Graph Generation	May 17, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1
Visual Relationship Detection using Scene Graphs: A Survey	May 16, 2020	Graph GenerationImage Generation	—Unverified	0
Relation Transformer Network	Apr 13, 2020	DecoderGraph Generation	CodeCode Available	1
GPS-Net: Graph Property Sensing Network for Scene Graph Generation	Mar 29, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1
Unbiased Scene Graph Generation from Biased Training	Feb 27, 2020	Causal Inferencecounterfactual	CodeCode Available	2
Unbiased Scene Graph Generation via Rich and Fair Semantic Extraction	Feb 1, 2020	Graph GenerationRelation	—Unverified	0
NODIS: Neural Ordinary Differential Scene Understanding	Jan 14, 2020	AllGraph Generation	CodeCode Available	1
Weakly Supervised Visual Semantic Parsing	Jan 8, 2020	Graph GenerationImage Retrieval	CodeCode Available	1
Bridging Knowledge Graphs to Generate Scene Graphs	Jan 7, 2020	Graph GenerationKnowledge Graphs	CodeCode Available	1
Leveraging Auxiliary Text for Deep Recognition of Unseen Visual Relationships	Oct 27, 2019	Graph GenerationRelationship Detection	—Unverified	0
The Limited Multi-Label Projection Layer	Jun 20, 2019	General ClassificationGraph Generation	CodeCode Available	0
Learning Predicates as Functions to Enable Few-shot Scene Graph Prediction	Jun 12, 2019	Few-Shot LearningGraph Generation	—Unverified	0
Exploring Context and Visual Pattern of Relationship for Scene Graph Generation	Jun 1, 2019	DiversityGraph Generation	—Unverified	0
Contextual Translation Embedding for Visual Relationship Detection and Scene Graph Generation	May 28, 2019	Graph GenerationObject	—Unverified	0
Target-Tailored Source-Transformation for Scene Graph Generation	Apr 3, 2019	graph constructionGraph Generation	—Unverified	0
Scene Graph Generation with External Knowledge and Image Reconstruction	Apr 1, 2019	Graph GenerationImage Reconstruction	—Unverified	0
Visual Semantic Information Pursuit: A Survey	Mar 13, 2019	Graph Generationobject-detection	—Unverified	0
Knowledge-Embedded Routing Network for Scene Graph Generation	Mar 8, 2019	Graph GenerationScene Graph Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 12 of 13Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified