SOTAVerified

Scene Understanding

Scene understanding involves interpreting the visual information of a scene, including objects, their spatial relationships, and the overall layout. It goes beyond simple object recognition by considering the context and how objects relate to each other and the environment.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 1723 papers

TitleStatusHype
When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language ModelsCode7
Trajectory Prediction Meets Large Language Models: A SurveyCode5
OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action ModelCode4
GPT4Scene: Understand 3D Scenes from Videos with Vision-Language ModelsCode4
Senna: Bridging Large Vision-Language Models and End-to-End Autonomous DrivingCode4
Repurposing Diffusion-Based Image Generators for Monocular Depth EstimationCode4
Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language ModelsCode4
Distill Any Depth: Distillation Creates a Stronger Monocular Depth EstimatorCode4
SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMCode4
SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language PretrainingCode3
CrossOver: 3D Scene Cross-Modal AlignmentCode3
EPRecon: An Efficient Framework for Real-Time Panoptic 3D Reconstruction from Monocular VideoCode3
Embodied Understanding of Driving ScenariosCode3
iDisc: Internal Discretization for Monocular Depth EstimationCode3
DeepInteraction++: Multi-Modality Interaction for Autonomous DrivingCode3
HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and GenerationCode3
GARField: Group Anything with Radiance FieldsCode3
STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor ScenesCode3
SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAMCode3
Swin3D++: Effective Multi-Source Pretraining for 3D Indoor Scene UnderstandingCode3
Generalized Robot 3D Vision-Language Model with Fast Rendering and Pre-Training Vision-Language AlignmentCode3
AudioBench: A Universal Benchmark for Audio Large Language ModelsCode3
4D Panoptic Scene Graph GenerationCode3
SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous DrivingCode3
Sigma: Siamese Mamba Network for Multi-Modal Semantic SegmentationCode3
Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous DrivingCode3
MoAI: Mixture of All Intelligence for Large Language and Vision ModelsCode3
DFormerv2: Geometry Self-Attention for RGBD Semantic SegmentationCode3
Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal ModelsCode3
Inst3D-LMM: Instance-Aware 3D Scene Understanding with Multi-modal Instruction TuningCode2
InvPT: Inverted Pyramid Multi-task Transformer for Dense Scene UnderstandingCode2
Hier-SLAM: Scaling-up Semantics in SLAM with a Hierarchically Categorical Gaussian SplattingCode2
BinsFormer: Revisiting Adaptive Bins for Monocular Depth EstimationCode2
Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene UnderstandingCode2
InvPT++: Inverted Pyramid Multi-Task Transformer for Visual Scene UnderstandingCode2
GroupViT: Semantic Segmentation Emerges from Text SupervisionCode2
Grounded 3D-LLM with Referent TokensCode2
HAKE: A Knowledge Engine Foundation for Human Activity UnderstandingCode2
GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial TasksCode2
AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous DrivingCode2
3DGraphLLM: Combining Semantic Graphs and Large Language Models for 3D Scene UnderstandingCode2
GaussianPretrain: A Simple Unified 3D Gaussian Representation for Visual Pre-training in Autonomous DrivingCode2
IRef-VLA: A Benchmark for Interactive Referential Grounding with Imperfect Language in 3D ScenesCode2
A Unified Framework for 3D Scene UnderstandingCode2
FusionVision: A comprehensive approach of 3D object reconstruction and segmentation from RGB-D cameras using YOLO and fast segment anythingCode2
A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and FutureCode2
Feed-Forward SceneDINO for Unsupervised Semantic Scene CompletionCode2
GALIP: Generative Adversarial CLIPs for Text-to-Image SynthesisCode2
EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AICode2
EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene UnderstandingCode2
Show:102550
← PrevPage 1 of 35Next →
All datasetsSemantic Scene Understanding Challenge (passive actuation & ground-truth localisation)ADE20K valSemantic Scene Understanding Challenge (active actuation & ground-truth localisation)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ACRV BaselineOMQ0.44—Unverified
2Team VGAI (TCS Research)OMQ0.37—Unverified
3Demo_semantic_SLAMOMQ0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1CPN(ResNet-101)Mean IoU46.3—Unverified
#ModelMetricClaimedVerifiedStatus
1ACRV BaselineOMQ0.35—Unverified