Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 141–150 of 318 papers

Title	Date	Tasks	Status	Score
LinkNet: Relational Embedding for Scene Graph	Nov 15, 2018	Graph GenerationScene Graph Generation	CodeCode Available	5
Factorizable Net: An Efficient Subgraph-based Framework for Scene Graph Generation	Jun 29, 2018	ClusteringGraph Generation	CodeCode Available	5
OG-SGG: Ontology-Guided Scene Graph Generation. A Case Study in Transfer Learning for Telepresence Robotics	Feb 21, 2022	BIG-bench Machine LearningGraph Generation	CodeCode Available	5
After All, Only The Last Neuron Matters: Comparing Multi-modal Fusion Functions for Scene Graph Generation	Nov 9, 2020	AllGraph Generation	CodeCode Available	5
Exploiting Long-Term Dependencies for Generating Dynamic Scene Graphs	Dec 18, 2021	Graph GenerationObject	CodeCode Available	5
Multi-Label Meta Weighting for Long-Tailed Dynamic Scene Graph Generation	Jun 16, 2023	Graph GenerationMeta-Learning	CodeCode Available	5
LABRAD-OR: Lightweight Memory Scene Graphs for Accurate Bimodal Reasoning in Dynamic Operating Rooms	Mar 23, 2023	Scene Graph Generation	CodeCode Available	5
Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction	Feb 15, 2018	Scene Graph ClassificationScene Graph Generation	CodeCode Available	5
KnowZRel: Common Sense Knowledge-based Zero-Shot Relationship Retrieval for Generalised Scene Graph Generation	Feb 21, 2025	Common Sense ReasoningGraph Generation	CodeCode Available	5
LLM Meets Scene Graph: Can Large Language Models Understand and Generate Scene Graphs? A Benchmark and Empirical Study	May 26, 2025	Graph GenerationScene Graph Generation	CodeCode Available	5

Show:10 25 50

← PrevPage 15 of 32Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified