Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 101–125 of 318 papers

Title	Date	Tasks	Status	Hype
Panoptic Video Scene Graph Generation	Nov 28, 2023	Graph GenerationPanoptic Scene Graph Generation	CodeCode Available	1
VLPrompt: Vision-Language Prompting for Panoptic Scene Graph Generation	Nov 27, 2023	Graph GenerationPanoptic Scene Graph Generation	CodeCode Available	1
Enhancing Scene Graph Generation with Hierarchical Relationships and Commonsense Knowledge	Nov 21, 2023	Large Language ModelMultimodal Deep Learning	CodeCode Available	1
Expanding Scene Graph Boundaries: Fully Open-vocabulary Scene Graph Generation via Visual-Concept Alignment and Retention	Nov 18, 2023	Concept AlignmentGraph Generation	CodeCode Available	1
Two Stream Scene Understanding on Graph Embedding	Nov 12, 2023	Graph AttentionGraph Embedding	—Unverified	0
NeuSyRE: Neuro-Symbolic Visual Understanding and Reasoning Framework based on Scene Graph Enrichment	Nov 5, 2023	Caption GenerationCommon Sense Reasoning	CodeCode Available	1
Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detection	Nov 3, 2023	Graph GenerationHuman-Object Interaction Detection	—Unverified	0
Semantic Scene Graph Generation Based on an Edge Dual Scene Graph and Message Passing Neural Network	Nov 2, 2023	Graph GenerationRelation	—Unverified	0
FloCoDe: Unbiased Dynamic Scene Graph Generation with Temporal Consistency and Correlation Debiasing	Oct 24, 2023	Graph GenerationScene Graph Generation	—Unverified	0
VidCoM: Fast Video Comprehension through Large Language Models with Multimodal Tools	Oct 16, 2023	Caption GenerationDescriptive	—Unverified	0
LLM4SGG: Large Language Models for Weakly Supervised Scene Graph Generation	Oct 16, 2023	Few-Shot LearningLarge Language Model	CodeCode Available	1
TextPSG: Panoptic Scene Graph Generation from Textual Descriptions	Oct 10, 2023	Graph GenerationPanoptic Scene Graph Generation	—Unverified	0
Domain-wise Invariant Learning for Panoptic Scene Graph Generation	Oct 9, 2023	Graph GenerationPanoptic Scene Graph Generation	—Unverified	0
Adaptive Visual Scene Understanding: Incremental Scene Graph Generation	Oct 2, 2023	BenchmarkingContinual Learning	CodeCode Available	0
Less is More: Toward Zero-Shot Local Scene Graph Generation via Foundation Models	Oct 2, 2023	Graph GenerationScene Graph Generation	CodeCode Available	1
Logical Bias Learning for Object Relation Prediction	Oct 1, 2023	Causal InferenceDecision Making	—Unverified	0
Spatial-Temporal Knowledge-Embedded Transformer for Video Scene Graph Generation	Sep 23, 2023	Graph GenerationObject	CodeCode Available	1
Predicate Classification Using Optimal Transport Loss in Scene Graph Generation	Sep 19, 2023	Graph GenerationPredicate Classification	—Unverified	0
Towards Debiasing Frame Length Bias in Text-Video Retrieval via Causal Intervention	Sep 17, 2023	Action RecognitionGraph Generation	—Unverified	0
STDG: Semi-Teacher-Student Training Paradigram for Depth-guided One-stage Scene Graph Generation	Sep 15, 2023	Graph GenerationScene Graph Generation	—Unverified	0
Zero-Shot Scene Graph Generation via Triplet Calibration and Reduction	Sep 7, 2023	Graph GenerationScene Graph Generation	CodeCode Available	1
RepSGG: Novel Representations of Entities and Relationships for Scene Graph Generation	Sep 6, 2023	Graph GenerationScene Graph Generation	—Unverified	0
Haystack: A Panoptic Scene Graph Dataset to Evaluate Rare Predicate Classes	Sep 5, 2023	Graph GenerationScene Graph Generation	CodeCode Available	0
Towards Addressing the Misalignment of Object Proposal Evaluation for Vision-Language Tasks via Semantic Grounding	Sep 1, 2023	Graph GenerationImage Captioning	CodeCode Available	0
Head-Tail Cooperative Learning Network for Unbiased Scene Graph Generation	Aug 23, 2023	Graph GenerationPrediction	CodeCode Available	0

Show:10 25 50

← PrevPage 5 of 13Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified