Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 76–100 of 318 papers

Title	Date	Tasks	Status	Hype
Topic Scene Graph Generation by Attention Distillation from Caption	Oct 12, 2021	Caption GenerationGraph Generation	CodeCode Available	1
GeneAnnotator: A Semi-automatic Annotation Tool for Visual Scene Graph	Sep 6, 2021	Graph GenerationGraph Learning	CodeCode Available	1
Learning to Generate Scene Graph from Natural Language Supervision	Sep 6, 2021	Graph GenerationScene Graph Generation	CodeCode Available	1
roadscene2vec: A Tool for Extracting and Embedding Road Scene-Graphs	Sep 2, 2021	Action ClassificationGraph Embedding	CodeCode Available	1
From General to Specific: Informative Scene Graph Generation via Balance Adjustment	Aug 30, 2021	BlockingGraph Generation	CodeCode Available	1
Target Adaptive Context Aggregation for Video Scene Graph Generation	Aug 18, 2021	Graph GenerationRelation	CodeCode Available	1
Spatial-Temporal Transformer for Dynamic Scene Graph Generation	Jul 26, 2021	DecoderScene Graph Generation	CodeCode Available	1
Scenes and Surroundings: Scene Graph Generation using Relation Transformer	Jul 12, 2021	Graph GenerationObject	CodeCode Available	1
Zero-Shot Scene Graph Relation Prediction through Commonsense Knowledge Integration	Jul 11, 2021	Graph GenerationGraph Mining	CodeCode Available	1
Recovering the Unbiased Scene Graphs from the Biased Ones	Jul 5, 2021	Missing LabelsScene Graph Classification	CodeCode Available	1
Structured Sparse R-CNN for Direct Scene Graph Generation	Jun 21, 2021	graph constructionGraph Generation	CodeCode Available	1
Tackling the Challenges in Scene Graph Generation with Local-to-Global Interactions	Jun 16, 2021	Bidirectional Relationship ClassificationDiagnostic	CodeCode Available	1
Linguistic Structures as Weak Supervision for Visual Scene Graph Generation	May 28, 2021	Graph GenerationScene Graph Generation	CodeCode Available	1
Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generation	Apr 1, 2021	Graph GenerationGraph Neural Network	CodeCode Available	1
Fully Convolutional Scene Graph Generation	Mar 30, 2021	Graph GenerationScene Graph Generation	CodeCode Available	1
Visual Distant Supervision for Scene Graph Generation	Mar 29, 2021	Graph GenerationPredicate Classification	CodeCode Available	1
SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequences	Mar 27, 2021	3D Object Classification3d scene graph generation	CodeCode Available	1
Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generation	Mar 9, 2021	Graph GenerationScene Graph Generation	CodeCode Available	1
Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysis	Mar 9, 2021	3d scene graph generationgraph construction	CodeCode Available	1
Energy-Based Learning for Scene Graph Generation	Mar 3, 2021	Graph GenerationInductive Bias	CodeCode Available	1
Context-Aware Scene Graph Generation With Seq2Seq Transformers	Jan 1, 2021	DecoderGraph Generation	CodeCode Available	1
Dense Relational Image Captioning via Multi-task Triple-Stream Networks	Oct 8, 2020	Graph GenerationImage Captioning	CodeCode Available	1
Are scene graphs good enough to improve Image Captioning?	Sep 25, 2020	DecoderGraph Attention	CodeCode Available	1
CogTree: Cognition Tree Loss for Unbiased Scene Graph Generation	Sep 16, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1
PCPL: Predicate-Correlation Perception Learning for Unbiased Scene Graph Generation	Sep 2, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 4 of 13Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified