SOTAVerified

Visual Navigation

Visual Navigation is the problem of navigating an agent, e.g. a mobile robot, in an environment using camera input only. The agent is given a target image (an image it will see from the target position), and its goal is to move from its current position to the target by applying a sequence of actions, based on the camera observations only.

Source: Vision-based Navigation Using Deep Reinforcement Learning

Papers

Showing 125 of 316 papers

TitleStatusHype
XFeat: Accelerated Features for Lightweight Image MatchingCode5
Navigation World ModelsCode4
ViNT: A Foundation Model for Visual NavigationCode3
Visual Planning: Let's Think Only with ImagesCode3
CityWalker: Learning Embodied Urban Navigation from Web-Scale VideosCode3
SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic LearningCode2
BEVBert: Multimodal Map Pre-training for Language-guided NavigationCode2
Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language NavigationCode2
Towards Learning a Generalist Model for Embodied NavigationCode2
Prior Does Matter: Visual Navigation via Denoising Diffusion Bridge ModelsCode2
Scaling Data Generation in Vision-and-Language NavigationCode2
NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language ModelsCode2
GaussNav: Gaussian Splatting for Visual NavigationCode2
LSceneLLM: Enhancing Large 3D Scene Understanding Using Adaptive Visual PreferencesCode2
POPGym: Benchmarking Partially Observable Reinforcement LearningCode2
GOAT-Bench: A Benchmark for Multi-Modal Lifelong NavigationCode2
Vision-and-Language Navigation via Causal LearningCode2
NaviDiffusor: Cost-Guided Diffusion Model for Visual NavigationCode2
Cognitive Mapping and Planning for Visual NavigationCode1
EndoMamba: An Efficient Foundation Model for Endoscopic Videos via Hierarchical Pre-trainingCode1
CaMP: Causal Multi-policy Planning for Interactive Navigation in Multi-room ScenesCode1
An Open Source and Open Hardware Deep Learning-powered Visual Navigation Engine for Autonomous Nano-UAVsCode1
CaMP: Causal Multi-policy Planning for Interactive Navigation in Multi-room ScenesCode1
Catch Me If You Hear Me: Audio-Visual Navigation in Complex Unmapped Environments with Moving SoundsCode1
End-to-End Egospheric Spatial MemoryCode1
Show:102550
← PrevPage 1 of 13Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1NaviLLMdist_to_end_reduction7.9Unverified
2VLN-PETLdist_to_end_reduction6.13Unverified
3early to beddist_to_end_reduction6.03Unverified
4HAMTdist_to_end_reduction5.58Unverified
5s-agent (NDH-Full)dist_to_end_reduction5.27Unverified
6BabyWalk (r2r-pretrain)dist_to_end_reduction4.46Unverified
7Environment-agnostic Multitask Learningdist_to_end_reduction3.91Unverified
8BabyWalkdist_to_end_reduction3.65Unverified
9Test2-NDHdist_to_end_reduction3.44Unverified
10SCoAdist_to_end_reduction3.37Unverified
#ModelMetricClaimedVerifiedStatus
1SUSAspl0.64Unverified
2Meta-Explorespl0.61Unverified
3NaviLLMspl0.6Unverified
4BEV-BERTspl0.6Unverified
5HOPspl0.59Unverified
6DUETspl0.58Unverified
7VLN-PETLspl0.58Unverified
8VLN-BERTspl0.57Unverified
9Prevalentspl0.51Unverified
10RCM+SIL(no early exploration)spl0.38Unverified
#ModelMetricClaimedVerifiedStatus
1AutoVLNNav-SPL27.83Unverified
2NaviLLMNav-SPL26.26Unverified
3Meta-ExploreNav-SPL25.8Unverified
4SUSANav-SPL25.47Unverified
5DUETNav-SPL21.42Unverified
6GBENav-SPL13.3Unverified
#ModelMetricClaimedVerifiedStatus
1MVV-INSPL (All)17.27Unverified
2SAVNSPL (All)16.15Unverified
#ModelMetricClaimedVerifiedStatus
1PopArt-IMPALAMedium Human-Normalized Score72.8Unverified
#ModelMetricClaimedVerifiedStatus
1Prevalentspl28.72Unverified