Scene Graph Generation

A scene graph is a structured representation of an image, where nodes in a scene graph correspond to object bounding boxes with their object categories, and edges correspond to their pairwise relationships between objects. The task of Scene Graph Generation is to generate a visually-grounded scene graph that most accurately correlates with an image.

Source: Scene Graph Generation by Iterative Message Passing

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 251–275 of 318 papers

Title	Date	Tasks	Status	Hype
Segmentation-grounded Scene Graph Generation	Apr 29, 2021	Graph GenerationMulti-Task Learning	—Unverified	0
Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generation	Apr 1, 2021	Graph GenerationGraph Neural Network	CodeCode Available	1
Fully Convolutional Scene Graph Generation	Mar 30, 2021	Graph GenerationScene Graph Generation	CodeCode Available	1
Visual Distant Supervision for Scene Graph Generation	Mar 29, 2021	Graph GenerationPredicate Classification	CodeCode Available	1
SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequences	Mar 27, 2021	3D Object Classification3d scene graph generation	CodeCode Available	1
Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generation	Mar 9, 2021	Graph GenerationScene Graph Generation	CodeCode Available	1
Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysis	Mar 9, 2021	3d scene graph generationgraph construction	CodeCode Available	1
Energy-Based Learning for Scene Graph Generation	Mar 3, 2021	Graph GenerationInductive Bias	CodeCode Available	1
Understanding the Role of Scene Graphs in Visual Question Answering	Jan 14, 2021	Graph GenerationQuestion Answering	—Unverified	0
Context-Aware Scene Graph Generation With Seq2Seq Transformers	Jan 1, 2021	DecoderGraph Generation	CodeCode Available	1
Topic Scene Graph Generation by Attention Distillation From Caption	Jan 1, 2021	Caption GenerationGraph Generation	—Unverified	0
A Simple Baseline for Weakly-Supervised Scene Graph Generation	Jan 1, 2021	Contrastive LearningGraph Generation	—Unverified	0
Counterfactual Thinking for Long-tailed Information Extraction	Jan 1, 2021	Causal Inferencecounterfactual	—Unverified	0
Self-Supervised Real-to-Sim Scene Generation	Nov 30, 2020	Graph GenerationScene Generation	—Unverified	0
Bridging Scene Understanding and Task Execution with Flexible Simulation Environments	Nov 20, 2020	Graph Generationreinforcement-learning	—Unverified	0
After All, Only The Last Neuron Matters: Comparing Multi-modal Fusion Functions for Scene Graph Generation	Nov 9, 2020	AllGraph Generation	CodeCode Available	0
Dual ResGCN for Balanced Scene GraphGeneration	Nov 9, 2020	Graph GenerationRelation	—Unverified	0
Dense Relational Image Captioning via Multi-task Triple-Stream Networks	Oct 8, 2020	Graph GenerationImage Captioning	CodeCode Available	1
Sim2SG: Sim-to-Real Scene Graph Generation for Transfer Learning	Sep 28, 2020	Graph GenerationScene Graph Generation	—Unverified	0
Are scene graphs good enough to improve Image Captioning?	Sep 25, 2020	DecoderGraph Attention	CodeCode Available	1
CogTree: Cognition Tree Loss for Unbiased Scene Graph Generation	Sep 16, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1
Exploring the Hierarchy in Relation Labels for Scene Graph Generation	Sep 12, 2020	Graph GenerationRelation	—Unverified	0
PCPL: Predicate-Correlation Perception Learning for Unbiased Scene Graph Generation	Sep 2, 2020	Graph GenerationScene Graph Generation	CodeCode Available	1
Tackling the Unannotated: Scene Graph Generation with Bias-Reduced Models	Aug 18, 2020	Graph GenerationScene Graph Generation	—Unverified	0
HOSE-Net: Higher Order Structure Embedded Network for Scene Graph Generation	Aug 12, 2020	General ClassificationGraph Generation	—Unverified	0

Show:10 25 50

← PrevPage 11 of 13Next →

All datasets Visual Genome 4D-OR 3R-Scan VRD GQA MM-OR MS-COCO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ExpressiveSGG	R@100	39.12	—	Unverified
2	NeuSyRE	R@100	39.1	—	Unverified
3	KnowZRel	zR@100	35.65	—	Unverified
4	SpeaQ (without reweighting)	Recall@50	32.9	—	Unverified
5	SpeaQ (with reweighting)	Recall@50	32.1	—	Unverified
6	Causal-TDE	Recall@50	31.93	—	Unverified
7	SG-EBM	Recall@50	31.74	—	Unverified
8	GPS-Net	Recall@50	28.9	—	Unverified
9	LOGIN	Recall@50	28.2	—	Unverified
10	VCTree	Recall@50	27.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ORacle	F1	0.91	—	Unverified
2	MM2SG	F1	0.9	—	Unverified
3	Pix2SG	F1	0.9	—	Unverified
4	LABRAD-OR	F1	0.88	—	Unverified
5	4D-OR baseline	F1	0.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SceneGraphFusion	Top-5 Accuracy	0.87	—	Unverified
2	3DSSG [Wald2020_3dssg]	Top-5 Accuracy	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FactorizableNet	Recall@50	18.32	—	Unverified
2	VRD	Recall@50	18.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KnowZRel	zR@100	29.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MM2SG	Macro F1	0.53	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NeuSyRE	R@100	38.5	—	Unverified