Visual Navigation

Visual Navigation is the problem of navigating an agent, e.g. a mobile robot, in an environment using camera input only. The agent is given a target image (an image it will see from the target position), and its goal is to move from its current position to the target by applying a sequence of actions, based on the camera observations only.

Source: Vision-based Navigation Using Deep Reinforcement Learning

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 276–300 of 316 papers

Title	Date	Tasks	Status	Hype
Shifting the Baseline: Single Modality Performance on Visual Navigation \& QA	Jun 1, 2019	Visual Navigation	—Unverified	0
SplitNet: Sim2Sim and Task2Task Transfer for Embodied Visual Navigation	May 18, 2019	Visual Navigation	CodeCode Available	0
Graph Attention Memory for Visual Navigation	May 11, 2019	Deep Reinforcement LearningGraph Attention	—Unverified	0
An Open Source and Open Hardware Deep Learning-powered Visual Navigation Engine for Autonomous Nano-UAVs	May 10, 2019	Autonomous NavigationVisual Navigation	CodeCode Available	1
Drone Path-Following in GPS-Denied Environments using Convolutional Networks	May 5, 2019	Data AugmentationDrone navigation	CodeCode Available	0
Scaling and Benchmarking Self-Supervised Visual Representation Learning	May 3, 2019	Benchmarkingobject-detection	CodeCode Available	0
Cross-Task Knowledge Transfer for Visually-Grounded Navigation	May 1, 2019	Deep Reinforcement LearningDisentanglement	—Unverified	0
Perceptual Attention-based Predictive Control	Apr 26, 2019	Model Predictive ControlUncertainty Quantification	—Unverified	0
Scene Memory Transformer for Embodied Agents in Long-Horizon Tasks	Mar 9, 2019	Decision Makingreinforcement-learning	—Unverified	0
Combining Optimal Control and Learning for Visual Navigation in Novel Environments	Mar 6, 2019	Robot NavigationVisual Navigation	—Unverified	0
Learning Exploration Policies for Navigation	Mar 5, 2019	Efficient ExplorationGeneral Reinforcement Learning	CodeCode Available	1
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation	Mar 5, 2019	Decision MakingVision and Language Navigation	CodeCode Available	0
The Regretful Navigation Agent for Vision-and-Language Navigation	Mar 5, 2019	Decision MakingVision and Language Navigation	CodeCode Available	0
A Behavioral Approach to Visual Navigation with Graph Localization Networks	Mar 1, 2019	NavigateVisual Navigation	—Unverified	0
MRS-VPR: a multi-resolution sampling based global visual place recognition method	Feb 26, 2019	Loop Closure DetectionVisual Navigation	—Unverified	0
Embodied Multimodal Multitask Learning	Feb 4, 2019	Deep Reinforcement LearningDisentanglement	—Unverified	0
Self-Monitoring Navigation Agent via Auxiliary Progress Estimation	Jan 10, 2019	Natural Language Visual GroundingVision and Language Navigation	CodeCode Available	1
Learning On-Road Visual Control for Self-Driving Vehicles with Auxiliary Tasks	Dec 19, 2018	Optical Flow EstimationSemantic Segmentation	—Unverified	0
Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning	Dec 3, 2018	Meta-LearningMeta Reinforcement Learning	CodeCode Available	1
Target Driven Visual Navigation with Hybrid Asynchronous Universal Successor Representations	Nov 27, 2018	NavigateVisual Navigation	—Unverified	0
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation	Nov 25, 2018	Imitation LearningReinforcement Learning	—Unverified	0
Object-oriented Targets for Visual Navigation using Rich Semantic Representations	Nov 22, 2018	NavigateObject	—Unverified	0
Shifting the Baseline: Single Modality Performance on Visual Navigation & QA	Nov 1, 2018	Question AnsweringVisual Navigation	—Unverified	0
Few-Shot Goal Inference for Visuomotor Learning and Planning	Sep 30, 2018	reinforcement-learningReinforcement Learning	—Unverified	0
Learning and Planning with a Semantic Model	Sep 28, 2018	Deep Reinforcement Learningmodel	—Unverified	0

Show:10 25 50

← PrevPage 12 of 13Next →

All datasets Cooperative Vision-and-Dialogue Navigation R2R SOON Test AI2-THOR Dmlab-30 Help, Anna! (HANNA)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	NaviLLM	dist_to_end_reduction	7.9	—	Unverified
2	VLN-PETL	dist_to_end_reduction	6.13	—	Unverified
3	early to bed	dist_to_end_reduction	6.03	—	Unverified
4	HAMT	dist_to_end_reduction	5.58	—	Unverified
5	s-agent (NDH-Full)	dist_to_end_reduction	5.27	—	Unverified
6	BabyWalk (r2r-pretrain)	dist_to_end_reduction	4.46	—	Unverified
7	Environment-agnostic Multitask Learning	dist_to_end_reduction	3.91	—	Unverified
8	BabyWalk	dist_to_end_reduction	3.65	—	Unverified
9	Test2-NDH	dist_to_end_reduction	3.44	—	Unverified
10	SCoA	dist_to_end_reduction	3.37	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SUSA	spl	0.64	—	Unverified
2	Meta-Explore	spl	0.61	—	Unverified
3	NaviLLM	spl	0.6	—	Unverified
4	BEV-BERT	spl	0.6	—	Unverified
5	HOP	spl	0.59	—	Unverified
6	DUET	spl	0.58	—	Unverified
7	VLN-PETL	spl	0.58	—	Unverified
8	VLN-BERT	spl	0.57	—	Unverified
9	Prevalent	spl	0.51	—	Unverified
10	RCM+SIL(no early exploration)	spl	0.38	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AutoVLN	Nav-SPL	27.83	—	Unverified
2	NaviLLM	Nav-SPL	26.26	—	Unverified
3	Meta-Explore	Nav-SPL	25.8	—	Unverified
4	SUSA	Nav-SPL	25.47	—	Unverified
5	DUET	Nav-SPL	21.42	—	Unverified
6	GBE	Nav-SPL	13.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MVV-IN	SPL (All)	17.27	—	Unverified
2	SAVN	SPL (All)	16.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PopArt-IMPALA	Medium Human-Normalized Score	72.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Prevalent	spl	28.72	—	Unverified