Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 176–200 of 318 papers

Title	Date	Tasks	Status	Hype
SG-Shuffle: Multi-aspect Shuffle Transformer for Scene Graph Generation	Nov 9, 2022	Graph GenerationScene Graph Generation	—Unverified	0
SGRAM: Improving Scene Graph Parsing via Abstract Meaning Representation	Oct 17, 2022	Abstract Meaning RepresentationDependency Parsing	—Unverified	0
Explore Contextual Information for 3D Scene Graph Generation	Oct 12, 2022	3d scene graph generationGraph Generation	—Unverified	0
Unbiased Scene Graph Generation using Predicate Similarities	Oct 3, 2022	DescriptiveGraph Generation	—Unverified	0
Scalable Regularization of Scene Graph Generation Models using Symbolic Theories	Sep 6, 2022	Graph GenerationScene Graph Generation	—Unverified	0
Towards Open-vocabulary Scene Graph Generation with Prompt-based Finetuning	Aug 17, 2022	Graph GenerationObject	—Unverified	0
Context-aware Mixture-of-Experts for Unbiased Scene Graph Generation	Aug 15, 2022	DiversityGraph Generation	—Unverified	0
Label Semantic Knowledge Distillation for Unbiased Scene Graph Generation	Aug 7, 2022	Graph GenerationKnowledge Distillation	—Unverified	0
Integrating Object-aware and Interaction-aware Knowledge for Weakly Supervised Scene Graph Generation	Aug 3, 2022	Graph GenerationObject	CodeCode Available	1
Rethinking the Evaluation of Unbiased Scene Graph Generation	Aug 3, 2022	DiversityGraph Generation	—Unverified	0
NICEST: Noisy Label Correction and Training for Robust Scene Graph Generation	Jul 27, 2022	Graph GenerationKnowledge Distillation	—Unverified	0
Iterative Scene Graph Generation	Jul 27, 2022	Graph GenerationScene Graph Generation	—Unverified	0
Meta Spatio-Temporal Debiasing for Video Scene Graph Generation	Jul 23, 2022	Graph GenerationMeta-Learning	—Unverified	0
Panoptic Scene Graph Generation	Jul 22, 2022	BenchmarkingPanoptic Scene Graph Generation	CodeCode Available	2
BusyBot: Learning to Interact, Reason, and Plan in a BusyBoard Environment	Jul 17, 2022	Causal DiscoveryRobot Manipulation	CodeCode Available	1
Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generation	Jul 16, 2022	Graph GenerationImage Captioning	CodeCode Available	1
Adaptive Fine-Grained Predicates Learning for Scene Graph Generation	Jul 11, 2022	Fine-Grained Image ClassificationGraph Generation	—Unverified	0
Learning Structured Representations of Visual Scenes	Jul 9, 2022	Human-Object Interaction DetectionRepresentation Learning	—Unverified	0
Learning To Generate Scene Graph from Head to Tail	Jun 23, 2022	Graph GenerationScene Graph Generation	—Unverified	0
Doubly Reparameterized Importance Weighted Structure Learning for Scene Graph Generation	Jun 22, 2022	Graph GenerationScene Graph Generation	—Unverified	0
The Devil is in the Labels: Noisy Label Correction for Robust Scene Graph Generation	Jun 7, 2022	AllGraph Generation	CodeCode Available	1
Expressive Scene Graph Generation Using Commonsense Knowledge Infusion for Visual Understanding and Reasoning	May 31, 2022	Common Sense ReasoningGraph Generation	CodeCode Available	1
GraphMapper: Efficient Visual Navigation by Scene Graph Generation	May 17, 2022	Graph GenerationNavigate	—Unverified	0
Importance Weighted Structure Learning for Scene Graph Generation	May 14, 2022	Graph GenerationScene Graph Generation	—Unverified	0
HL-Net: Heterophily Learning Network for Scene Graph Generation	May 3, 2022	Graph ClassificationGraph Generation	CodeCode Available	1

Show:10 25 50

← PrevPage 8 of 13Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified