Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 26–50 of 318 papers

Title	Date	Tasks	Status	Hype	Score
Are scene graphs good enough to improve Image Captioning?	Sep 25, 2020	DecoderGraph Attention	CodeCode Available	1	5
BusyBot: Learning to Interact, Reason, and Plan in a BusyBoard Environment	Jul 17, 2022	Causal DiscoveryRobot Manipulation	CodeCode Available	1	5
Adaptive Self-training Framework for Fine-grained Scene Graph Generation	Jan 18, 2024	Graph GenerationScene Graph Generation	CodeCode Available	1	5
A Review and Efficient Implementation of Scene Graph Generation Metrics	Apr 15, 2024	BenchmarkingGraph Generation	CodeCode Available	1	5
Graph R-CNN for Scene Graph Generation	Aug 1, 2018	Graph GenerationScene Graph Generation	CodeCode Available	1	5
From General to Specific: Informative Scene Graph Generation via Balance Adjustment	Aug 30, 2021	BlockingGraph Generation	CodeCode Available	1	5
Fine-Grained Predicates Learning for Scene Graph Generation	Apr 6, 2022	Fine-Grained Image ClassificationGraph Generation	CodeCode Available	1	5
SPAN: Learning Similarity between Scene Graphs and Images with Transformers	Apr 2, 2023	Contrastive LearningGraph Generation	CodeCode Available	1	5
LANDMARK: Language-guided Representation Enhancement Framework for Scene Graph Generation	Mar 2, 2023	Graph GenerationObject	CodeCode Available	1	5
Fully Convolutional Scene Graph Generation	Mar 30, 2021	Graph GenerationScene Graph Generation	CodeCode Available	1	5
HL-Net: Heterophily Learning Network for Scene Graph Generation	May 3, 2022	Graph ClassificationGraph Generation	CodeCode Available	1	5
Learning and Reasoning with the Graph Structure Representation in Robotic Surgery	Jul 7, 2020	Edge ClassificationGraph Generation	CodeCode Available	1	5
Enhancing Scene Graph Generation with Hierarchical Relationships and Commonsense Knowledge	Nov 21, 2023	Large Language ModelMultimodal Deep Learning	CodeCode Available	1	5
Energy-Based Learning for Scene Graph Generation	Mar 3, 2021	Graph GenerationInductive Bias	CodeCode Available	1	5
Expressive Scene Graph Generation Using Commonsense Knowledge Infusion for Visual Understanding and Reasoning	May 31, 2022	Common Sense ReasoningGraph Generation	CodeCode Available	1	5
Integrating Object-aware and Interaction-aware Knowledge for Weakly Supervised Scene Graph Generation	Aug 3, 2022	Graph GenerationObject	CodeCode Available	1	5
Knowledge-Embedded Routing Network for Scene Graph Generation	Mar 8, 2019	Graph GenerationScene Graph Generation	CodeCode Available	1	5
Expanding Scene Graph Boundaries: Fully Open-vocabulary Scene Graph Generation via Visual-Concept Alignment and Retention	Nov 18, 2023	Concept AlignmentGraph Generation	CodeCode Available	1	5
Fine-Grained Scene Graph Generation with Data Transfer	Mar 22, 2022	Graph GenerationPredicate Classification	CodeCode Available	1	5
Biasing Like Human: A Cognitive Bias Framework for Scene Graph Generation	Mar 17, 2022	Graph GenerationPredicate Classification	CodeCode Available	1	5
Dense Relational Image Captioning via Multi-task Triple-Stream Networks	Oct 8, 2020	Graph GenerationImage Captioning	CodeCode Available	1	5
Context-Aware Scene Graph Generation With Seq2Seq Transformers	Jan 1, 2021	DecoderGraph Generation	CodeCode Available	1	5
DIFFVSGG: Diffusion-Driven Online Video Scene Graph Generation	Mar 18, 2025	DenoisingGPU	CodeCode Available	1	5
Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generation	Apr 1, 2021	Graph GenerationGraph Neural Network	CodeCode Available	1	5
4D-OR: Semantic Scene Graphs for OR Domain Modeling	Mar 22, 2022	Scene Graph Generation	CodeCode Available	1	5

Show:10 25 50

← PrevPage 2 of 13Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified