SOTAVerified

Scene Understanding

Scene understanding involves interpreting the visual information of a scene, including objects, their spatial relationships, and the overall layout. It goes beyond simple object recognition by considering the context and how objects relate to each other and the environment.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 1723 papers

TitleStatusHype
TADFormer : Task-Adaptive Dynamic Transformer for Efficient Multi-Task Learning—0
Advancing the Understanding of Fine-Grained 3D Forest Structures using Digital Cousins and Simulation-to-Reality: Methods and Datasets—0
LargeAD: Large-Scale Cross-Sensor Data Pretraining for Autonomous Driving—0
CL3DOR: Contrastive Learning for 3D Large Multimodal Models via Odds Ratio on High-Resolution Point Clouds—0
IAM: Enhancing RGB-D Instance Segmentation with New BenchmarksCode0
VideoLifter: Lifting Videos to 3D with Fast Hierarchical Stereo AlignmentCode2
3D-LLaVA: Towards Generalist 3D LMMs with Omni Superpoint Transformer—0
GPT4Scene: Understand 3D Scenes from Videos with Vision-Language ModelsCode4
Leverage Cross-Attention for End-to-End Open-Vocabulary Panoptic Reconstruction—0
GroundingFace: Fine-grained Face Understanding via Pixel Grounding Multimodal Large Language Model—0
Vision-Language Embodiment for Monocular Depth Estimation—0
3D-MVP: 3D Multiview Pretraining for Manipulation—0
HUSH: Holistic Panoramic 3D Scene Understanding using Spherical Harmonics—0
Beyond Human Perception: Understanding Multi-Object World from Monocular ViewCode0
Scene Map-based Prompt Tuning for Navigation Instruction Generation—0
AVQACL: A Novel Benchmark for Audio-Visual Question Answering Continual LearningCode0
All-Day Multi-Camera Multi-Target TrackingCode1
Object-aware Sound Source Localization via Audio-Visual Scene UnderstandingCode0
TADFormer: Task-Adaptive Dynamic TransFormer for Efficient Multi-Task Learning—0
Embodied VideoAgent: Persistent Memory from Egocentric Videos and Embodied Sensors Enables Dynamic Scene Understanding—0
OVGaussian: Generalizable 3D Gaussian Segmentation with Open VocabulariesCode0
STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor ScenesCode3
Text-to-Image GAN with Pretrained Representations—0
4D Gaussian Splatting: Modeling Dynamic Scenes with Native 4D Primitives—0
MLLM-SUL: Multimodal Large Language Model for Semantic Scene Understanding and Localization in Traffic ScenariosCode0
UniPLV: Towards Label-Efficient Open-World 3D Scene Understanding by Regional Visual Language Supervision—0
Parallel Neural Computing for Scene Understanding from LiDAR Perception in Autonomous RacingCode0
3DGraphLLM: Combining Semantic Graphs and Large Language Models for 3D Scene UnderstandingCode2
LangSurf: Language-Embedded Surface Gaussians for 3D Scene Understanding—0
Application of Multimodal Large Language Models in Autonomous Driving—0
Improving Object Detection for Time-Lapse Imagery Using Temporal Features in Wildlife MonitoringCode0
PC-BEV: An Efficient Polar-Cartesian BEV Fusion Framework for LiDAR Semantic SegmentationCode1
ObjVariantEnsemble: Advancing Point Cloud LLM Evaluation in Challenging Scenes with Subtly Distinguished Objects—0
AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous DrivingCode2
RelationField: Relate Anything in Radiance FieldsCode2
Multi-View Pedestrian Occupancy Prediction with a Novel Synthetic Dataset—0
GAGS: Granularity-Aware Feature Distillation for Language Gaussian Splatting—0
Dense Audio-Visual Event Localization under Cross-Modal Consistency and Multi-Temporal Granularity CollaborationCode1
An Enhanced Classification Method Based on Adaptive Multi-Scale Fusion for Long-tailed Multispectral Point Clouds—0
DINO-Foresight: Looking into the Future with DINOCode2
Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial ReasoningCode2
SuperGSeg: Open-Vocabulary 3D Segmentation with Structured Super-Gaussians—0
WiseAD: Knowledge Augmented End-to-End Autonomous Driving with Vision-Language ModelCode1
MAGIC: Mastering Physical Adversarial Generation in Context through Collaborative LLM Agents—0
TGOSPA Metric Parameters Selection and Evaluation for Visual Multi-object Tracking—0
SLGaussian: Fast Language Gaussian Splatting in Sparse Views—0
Event fields: Capturing light fields at high speed, resolution, and dynamic range—0
LLaVA-SpaceSGG: Visual Instruct Tuning for Open-vocabulary Scene Graph Generation with Enhanced Spatial RelationsCode1
Visual Lexicon: Rich Image Features in Language Space—0
TB-HSU: Hierarchical 3D Scene Understanding with Contextual Affordances—0
Show:102550
← PrevPage 6 of 35Next →
All datasetsSemantic Scene Understanding Challenge (passive actuation & ground-truth localisation)ADE20K valSemantic Scene Understanding Challenge (active actuation & ground-truth localisation)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ACRV BaselineOMQ0.44—Unverified
2Team VGAI (TCS Research)OMQ0.37—Unverified
3Demo_semantic_SLAMOMQ0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1CPN(ResNet-101)Mean IoU46.3—Unverified
#ModelMetricClaimedVerifiedStatus
1ACRV BaselineOMQ0.35—Unverified