Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 301–318 of 318 papers

Title	Date	Tasks	Status
Unified Visual Relationship Detection with Vision and Language Models	Mar 16, 2023	Human-Object Interaction DetectionRelationship Detection	CodeCode Available
Situational Scene Graph for Structured Human-centric Situation Understanding	Oct 30, 2024	Graph GenerationPredicate Classification	CodeCode Available
Image Scene Graph Generation (SGG) Benchmark	Jul 27, 2021	AttributeGraph Generation	CodeCode Available
Weakly-Supervised 3D Scene Graph Generation via Visual-Linguistic Assisted Pseudo-labeling	Apr 3, 2024	3d scene graph generationGraph Generation	CodeCode Available
SGDraw: Scene Graph Drawing Interface Using Object-Oriented Representation	Nov 30, 2022	Graph GenerationImage Generation	CodeCode Available
The Limited Multi-Label Projection Layer	Jun 20, 2019	General ClassificationGraph Generation	CodeCode Available
Benchmarking Federated Learning for Semantic Datasets: Federated Scene Graph Generation	Dec 11, 2024	BenchmarkingFederated Learning	CodeCode Available
SCENIR: Visual Semantic Clarity through Unsupervised Scene Graph Retrieval	May 21, 2025	counterfactualGraph Generation	CodeCode Available
Supplementing Missing Visions via Dialog for Scene Graph Generations	Apr 23, 2022	Graph GenerationScene Graph Generation	CodeCode Available
LinkNet: Relational Embedding for Scene Graph	Nov 15, 2018	Graph GenerationScene Graph Generation	CodeCode Available
Cross-Modality Time-Variant Relation Learning for Generating Dynamic Scene Graphs	May 15, 2023	RelationScene Graph Generation	CodeCode Available
LLM Meets Scene Graph: Can Large Language Models Understand and Generate Scene Graphs? A Benchmark and Empirical Study	May 26, 2025	Graph GenerationScene Graph Generation	CodeCode Available
Voxel Scene Graph for Intracranial Hemorrhage	Jul 31, 2024	Decision MakingGraph Generation	CodeCode Available
Towards Addressing the Misalignment of Object Proposal Evaluation for Vision-Language Tasks via Semantic Grounding	Sep 1, 2023	Graph GenerationImage Captioning	CodeCode Available
Haystack: A Panoptic Scene Graph Dataset to Evaluate Rare Predicate Classes	Sep 5, 2023	Graph GenerationScene Graph Generation	CodeCode Available
Scene Graph Generation from Objects, Phrases and Region Captions	Jul 31, 2017	Graph Generationobject-detection	CodeCode Available
Pixels to Graphs by Associative Embedding	Jun 22, 2017	Graph GenerationScene Graph Generation	CodeCode Available
Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction	Feb 15, 2018	Scene Graph ClassificationScene Graph Generation	CodeCode Available

Show:10 25 50

← PrevPage 7 of 7Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified