Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 151–175 of 318 papers

Title	Date	Tasks	Status	Hype
HiLo: Exploiting High Low Frequency Relations for Unbiased Panoptic Scene Graph Generation	Mar 28, 2023	Panoptic Scene Graph GenerationScene Graph Generation	CodeCode Available	1
Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World	Mar 23, 2023	Graph GenerationLanguage Modeling	CodeCode Available	1
Taking A Closer Look at Visual Relation: Unbiased Video Scene Graph Generation with Decoupled Label Learning	Mar 23, 2023	Graph GenerationRelation Prediction	CodeCode Available	0
LABRAD-OR: Lightweight Memory Scene Graphs for Accurate Bimodal Reasoning in Dynamic Operating Rooms	Mar 23, 2023	Scene Graph Generation	CodeCode Available	0
Decomposed Prototype Learning for Few-Shot Scene Graph Generation	Mar 20, 2023	Few-Shot LearningGraph Generation	—Unverified	0
Location-Free Scene Graph Generation	Mar 20, 2023	Graph GenerationImage Retrieval	CodeCode Available	1
SGFormer: Semantic Graph Transformer for Point Cloud-based 3D Scene Graph Generation	Mar 20, 2023	3d scene graph generationGraph Embedding	CodeCode Available	1
Unified Visual Relationship Detection with Vision and Language Models	Mar 16, 2023	Human-Object Interaction DetectionRelationship Detection	CodeCode Available	0
Hierarchical Relationships: A New Perspective to Enhance Scene Graph Generation	Mar 13, 2023	Contrastive LearningGraph Generation	CodeCode Available	1
Prototype-based Embedding Network for Scene Graph Generation	Mar 13, 2023	Graph GenerationRelation	CodeCode Available	1
LANDMARK: Language-guided Representation Enhancement Framework for Scene Graph Generation	Mar 2, 2023	Graph GenerationObject	CodeCode Available	1
Instance-incremental Scene Graph Generation from Real-world Point Clouds via Normalizing Flows	Feb 21, 2023	Graph GenerationScene Graph Generation	—Unverified	0
Explicit3D: Graph Network with Spatial Inference for Single Image 3D Object Detection	Feb 13, 2023	3D Object DetectionGraph Generation	—Unverified	0
Self-Supervised Relation Alignment for Scene Graph Generation	Feb 2, 2023	Graph GenerationRelation	—Unverified	0
DDS: Decoupled Dynamic Scene-Graph Generation Network	Jan 18, 2023	Graph GenerationObject	—Unverified	0
Learning To Generate Language-Supervised and Open-Vocabulary Scene Graph Using Pre-Trained Visual-Semantic Space	Jan 1, 2023	Graph Generationobject-detection	CodeCode Available	1
Fast Contextual Scene Graph Generation With Unbiased Context Augmentation	Jan 1, 2023	Graph GenerationScene Graph Generation	—Unverified	0
IS-GGT: Iterative Scene Graph Generation With Generative Transformers	Jan 1, 2023	Graph GenerationLink Prediction	—Unverified	0
Skew Class-balanced Re-weighting for Unbiased Scene Graph Generation	Jan 1, 2023	Graph GenerationScene Graph Generation	CodeCode Available	0
Peer Learning for Unbiased Scene Graph Generation	Dec 31, 2022	Graph GenerationScene Graph Generation	—Unverified	0
SrTR: Self-reasoning Transformer with Visual-linguistic Knowledge for Scene Graph Generation	Dec 19, 2022	DecoderGraph Generation	—Unverified	0
Unbiased Heterogeneous Scene Graph Generation with Relation-aware Message Passing Neural Network	Dec 1, 2022	Graph GenerationRelation	CodeCode Available	1
SGDraw: Scene Graph Drawing Interface Using Object-Oriented Representation	Nov 30, 2022	Graph GenerationImage Generation	CodeCode Available	0
Iterative Scene Graph Generation with Generative Transformers	Nov 30, 2022	Graph GenerationLink Prediction	—Unverified	0
An Enhanced Object Detection Model for Scene Graph Generation	Nov 18, 2022	Graph GenerationImage Captioning	—Unverified	0

Show:10 25 50

← PrevPage 7 of 13Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified