Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 51–75 of 318 papers

Title	Date	Tasks	Status	Hype	Score
Bridging Knowledge Graphs to Generate Scene Graphs	Jan 7, 2020	Graph GenerationKnowledge Graphs	CodeCode Available	1	5
Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generation	Jul 16, 2022	Graph GenerationImage Captioning	CodeCode Available	1	5
Are scene graphs good enough to improve Image Captioning?	Sep 25, 2020	DecoderGraph Attention	CodeCode Available	1	5
Learning Visual Commonsense for Robust Scene Graph Generation	Jun 17, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1	5
Graph R-CNN for Scene Graph Generation	Aug 1, 2018	Graph GenerationScene Graph Generation	CodeCode Available	1	5
OpenPSG: Open-set Panoptic Scene Graph Generation via Large Multimodal Models	Jul 15, 2024	Graph Generationobject-detection	CodeCode Available	1	5
NeuSyRE: Neuro-Symbolic Visual Understanding and Reasoning Framework based on Scene Graph Enrichment	Nov 5, 2023	Caption GenerationCommon Sense Reasoning	CodeCode Available	1	5
Energy-Based Learning for Scene Graph Generation	Mar 3, 2021	Graph GenerationInductive Bias	CodeCode Available	1	5
A Review and Efficient Implementation of Scene Graph Generation Metrics	Apr 15, 2024	BenchmarkingGraph Generation	CodeCode Available	1	5
Enhancing Scene Graph Generation with Hierarchical Relationships and Commonsense Knowledge	Nov 21, 2023	Large Language ModelMultimodal Deep Learning	CodeCode Available	1	5
SPAN: Learning Similarity between Scene Graphs and Images with Transformers	Apr 2, 2023	Contrastive LearningGraph Generation	CodeCode Available	1	5
Manga109Dialog: A Large-scale Dialogue Dataset for Comics Speaker Detection	Jun 30, 2023	Graph GenerationScene Graph Generation	CodeCode Available	1	5
NODIS: Neural Ordinary Differential Scene Understanding	Jan 14, 2020	AllGraph Generation	CodeCode Available	1	5
Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysis	Mar 9, 2021	3d scene graph generationgraph construction	CodeCode Available	1	5
A Fair Ranking and New Model for Panoptic Scene Graph Generation	Jul 12, 2024	Graph GenerationPanoptic Scene Graph Generation	CodeCode Available	1	5
Fully Convolutional Scene Graph Generation	Mar 30, 2021	Graph GenerationScene Graph Generation	CodeCode Available	1	5
Compositional Feature Augmentation for Unbiased Scene Graph Generation	Aug 13, 2023	DiversityGraph Generation	CodeCode Available	1	5
Expanding Scene Graph Boundaries: Fully Open-vocabulary Scene Graph Generation via Visual-Concept Alignment and Retention	Nov 18, 2023	Concept AlignmentGraph Generation	CodeCode Available	1	5
From General to Specific: Informative Scene Graph Generation via Balance Adjustment	Aug 30, 2021	BlockingGraph Generation	CodeCode Available	1	5
Fine-Grained Scene Graph Generation with Data Transfer	Mar 22, 2022	Graph GenerationPredicate Classification	CodeCode Available	1	5
4D-OR: Semantic Scene Graphs for OR Domain Modeling	Mar 22, 2022	Scene Graph Generation	CodeCode Available	1	5
Expressive Scene Graph Generation Using Commonsense Knowledge Infusion for Visual Understanding and Reasoning	May 31, 2022	Common Sense ReasoningGraph Generation	CodeCode Available	1	5
Context-Aware Scene Graph Generation With Seq2Seq Transformers	Jan 1, 2021	DecoderGraph Generation	CodeCode Available	1	5
Generative Compositional Augmentations for Scene Graph Prediction	Jul 11, 2020	Graph GenerationLanguage Modelling	CodeCode Available	1	5
CogTree: Cognition Tree Loss for Unbiased Scene Graph Generation	Sep 16, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1	5

Show:10 25 50

← PrevPage 3 of 13Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified