Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 51–75 of 318 papers

Title	Date	Tasks	Status	Hype	Score
Graph R-CNN for Scene Graph Generation	Aug 1, 2018	Graph GenerationScene Graph Generation	CodeCode Available	1	5
Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generation	Jul 16, 2022	Graph GenerationImage Captioning	CodeCode Available	1	5
Are scene graphs good enough to improve Image Captioning?	Sep 25, 2020	DecoderGraph Attention	CodeCode Available	1	5
Learning to Generate Scene Graph from Natural Language Supervision	Sep 6, 2021	Graph GenerationScene Graph Generation	CodeCode Available	1	5
OpenPSG: Open-set Panoptic Scene Graph Generation via Large Multimodal Models	Jul 15, 2024	Graph Generationobject-detection	CodeCode Available	1	5
EgoExOR: An Ego-Exo-Centric Operating Room Dataset for Surgical Activity Understanding	May 30, 2025	Action RecognitionGraph Generation	CodeCode Available	1	5
NeuSyRE: Neuro-Symbolic Visual Understanding and Reasoning Framework based on Scene Graph Enrichment	Nov 5, 2023	Caption GenerationCommon Sense Reasoning	CodeCode Available	1	5
Energy-Based Learning for Scene Graph Generation	Mar 3, 2021	Graph GenerationInductive Bias	CodeCode Available	1	5
A Review and Efficient Implementation of Scene Graph Generation Metrics	Apr 15, 2024	BenchmarkingGraph Generation	CodeCode Available	1	5
Enhancing Scene Graph Generation with Hierarchical Relationships and Commonsense Knowledge	Nov 21, 2023	Large Language ModelMultimodal Deep Learning	CodeCode Available	1	5
Learning and Reasoning with the Graph Structure Representation in Robotic Surgery	Jul 7, 2020	Edge ClassificationGraph Generation	CodeCode Available	1	5
Manga109Dialog: A Large-scale Dialogue Dataset for Comics Speaker Detection	Jun 30, 2023	Graph GenerationScene Graph Generation	CodeCode Available	1	5
NODIS: Neural Ordinary Differential Scene Understanding	Jan 14, 2020	AllGraph Generation	CodeCode Available	1	5
Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysis	Mar 9, 2021	3d scene graph generationgraph construction	CodeCode Available	1	5
A Fair Ranking and New Model for Panoptic Scene Graph Generation	Jul 12, 2024	Graph GenerationPanoptic Scene Graph Generation	CodeCode Available	1	5
Fully Convolutional Scene Graph Generation	Mar 30, 2021	Graph GenerationScene Graph Generation	CodeCode Available	1	5
Compositional Feature Augmentation for Unbiased Scene Graph Generation	Aug 13, 2023	DiversityGraph Generation	CodeCode Available	1	5
Expanding Scene Graph Boundaries: Fully Open-vocabulary Scene Graph Generation via Visual-Concept Alignment and Retention	Nov 18, 2023	Concept AlignmentGraph Generation	CodeCode Available	1	5
From General to Specific: Informative Scene Graph Generation via Balance Adjustment	Aug 30, 2021	BlockingGraph Generation	CodeCode Available	1	5
Fine-Grained Scene Graph Generation with Data Transfer	Mar 22, 2022	Graph GenerationPredicate Classification	CodeCode Available	1	5
4D-OR: Semantic Scene Graphs for OR Domain Modeling	Mar 22, 2022	Scene Graph Generation	CodeCode Available	1	5
Expressive Scene Graph Generation Using Commonsense Knowledge Infusion for Visual Understanding and Reasoning	May 31, 2022	Common Sense ReasoningGraph Generation	CodeCode Available	1	5
Context-Aware Scene Graph Generation With Seq2Seq Transformers	Jan 1, 2021	DecoderGraph Generation	CodeCode Available	1	5
Generative Compositional Augmentations for Scene Graph Prediction	Jul 11, 2020	Graph GenerationLanguage Modelling	CodeCode Available	1	5
CogTree: Cognition Tree Loss for Unbiased Scene Graph Generation	Sep 16, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1	5

Show:10 25 50

← PrevPage 3 of 13Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified