Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 101–125 of 318 papers

Title	Date	Tasks	Status	Hype	Score
Prototype-based Embedding Network for Scene Graph Generation	Mar 13, 2023	Graph GenerationRelation	CodeCode Available	1	5
ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models	Dec 9, 2024	Graph GenerationScene Graph Generation	CodeCode Available	1	5
Bridging Knowledge Graphs to Generate Scene Graphs	Jan 7, 2020	Graph GenerationKnowledge Graphs	CodeCode Available	1	5
Knowledge-Embedded Routing Network for Scene Graph Generation	Mar 8, 2019	Graph GenerationScene Graph Generation	CodeCode Available	1	5
HiLo: Exploiting High Low Frequency Relations for Unbiased Panoptic Scene Graph Generation	Mar 28, 2023	Panoptic Scene Graph GenerationScene Graph Generation	CodeCode Available	1	5
HL-Net: Heterophily Learning Network for Scene Graph Generation	May 3, 2022	Graph ClassificationGraph Generation	CodeCode Available	1	5
Are scene graphs good enough to improve Image Captioning?	Sep 25, 2020	DecoderGraph Attention	CodeCode Available	1	5
PCPL: Predicate-Correlation Perception Learning for Unbiased Scene Graph Generation	Sep 2, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1	5
Relation Transformer Network	Apr 13, 2020	DecoderGraph Generation	CodeCode Available	1	5
Structured Sparse R-CNN for Direct Scene Graph Generation	Jun 21, 2021	graph constructionGraph Generation	CodeCode Available	1	5
Unbiased Heterogeneous Scene Graph Generation with Relation-aware Message Passing Neural Network	Dec 1, 2022	Graph GenerationRelation	CodeCode Available	1	5
RU-Net: Regularized Unrolling Network for Scene Graph Generation	May 3, 2022	DenoisingDiversity	CodeCode Available	1	5
EgoExOR: An Ego-Exo-Centric Operating Room Dataset for Surgical Activity Understanding	May 30, 2025	Action RecognitionGraph Generation	CodeCode Available	1	5
SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequences	Mar 27, 2021	3D Object Classification3d scene graph generation	CodeCode Available	1	5
VLPrompt: Vision-Language Prompting for Panoptic Scene Graph Generation	Nov 27, 2023	Graph GenerationPanoptic Scene Graph Generation	CodeCode Available	1	5
Environment-Invariant Curriculum Relation Learning for Fine-Grained Scene Graph Generation	Aug 7, 2023	Graph GenerationObject	CodeCode Available	0	5
Situational Scene Graph for Structured Human-centric Situation Understanding	Oct 30, 2024	Graph GenerationPredicate Classification	CodeCode Available	0	5
Skew Class-balanced Re-weighting for Unbiased Scene Graph Generation	Jan 1, 2023	Graph GenerationScene Graph Generation	CodeCode Available	0	5
SGDraw: Scene Graph Drawing Interface Using Object-Oriented Representation	Nov 30, 2022	Graph GenerationImage Generation	CodeCode Available	0	5
SCENIR: Visual Semantic Clarity through Unsupervised Scene Graph Retrieval	May 21, 2025	counterfactualGraph Generation	CodeCode Available	0	5
Scene Graph Generation from Objects, Phrases and Region Captions	Jul 31, 2017	Graph Generationobject-detection	CodeCode Available	0	5
Image Scene Graph Generation (SGG) Benchmark	Jul 27, 2021	AttributeGraph Generation	CodeCode Available	0	5
S^2Former-OR: Single-Stage Bi-Modal Transformer for Scene Graph Generation in OR	Feb 22, 2024	Graph Generationobject-detection	CodeCode Available	0	5
DSGG: Dense Relation Transformer for an End-to-end Scene Graph Generation	Mar 21, 2024	Graph GenerationGraph Matching	CodeCode Available	0	5
ReFormer: The Relational Transformer for Image Captioning	Jul 29, 2021	Graph GenerationImage Captioning	CodeCode Available	0	5

Show:10 25 50

← PrevPage 5 of 13Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified