SOTAVerified

Optical Flow Estimation

Optical Flow Estimation is a computer vision task that involves computing the motion of objects in an image or a video sequence. The goal of optical flow estimation is to determine the movement of pixels or features in the image, which can be used for various applications such as object tracking, motion analysis, and video compression.

Approaches for optical flow estimation include correlation-based, block-matching, feature tracking, energy-based, and more recently gradient-based.

Further readings:

Definition source: Devon: Deformable Volume Network for Learning Optical Flow

Image credit: Optical Flow Estimation

Papers

Showing 251300 of 2184 papers

TitleStatusHype
KOI: Accelerating Online Imitation Learning via Hybrid Key-state Guidance0
NOLO: Navigate Only Look Once0
EMatch: A Unified Framework for Event-based Optical Flow and Stereo Matching0
RainMamba: Enhanced Locality Learning with State Space Models for Video DerainingCode2
SpotFormer: Multi-Scale Spatio-Temporal Transformer for Facial Expression Spotting0
Event-based Optical Flow on Neuromorphic Processor: ANN vs. SNN Comparison based on Activation SparsificationCode0
Revisit Event Generation Model: Self-Supervised Learning of Event-to-Video Reconstruction with Implicit Neural Representations0
Occlusion-Aware 3D Motion Interpretation for Abnormal Behavior Detection0
SAFNet: Selective Alignment Fusion Network for Efficient HDR ImagingCode1
Real-Time Image Analysis Software Suitable for Resource-Constrained ComputingCode0
Many Perception Tasks are Highly Redundant Functions of their Input Data0
Attenuation-Aware Weighted Optical Flow with Medium Transmission Map for Learning-based Visual Odometry in Underwater terrainCode0
Fusion Flow-enhanced Graph Pooling Residual Networks for Unmanned Aerial Vehicles Surveillance in Day and Night Dual Visions0
ReLaX-VQA: Residual Fragment and Layer Stack Extraction for Enhancing Video Quality AssessmentCode1
Improving Unsupervised Video Object Segmentation via Fake Flow Generation0
Comparing Optical Flow and Deep Learning to Enable Computationally Efficient Traffic Event Detection with Space-Filling Curves0
Temporal Event Stereo via Joint Learning with Stereoscopic FlowCode1
Motion-prior Contrast Maximization for Dense Continuous-Time Motion EstimationCode1
Research Experience of an Undergraduate Student in Computer Vision and Robotics0
ScaleFlow++: Robust and Accurate Estimation of 3D Motion from VideoCode1
Event-based vision on FPGAs -- a survey0
Let Occ Flow: Self-Supervised 3D Occupancy Flow Prediction0
Unsupervised 4D Cardiac Motion Tracking with Spatiotemporal Optical Flow Networks0
CardioSpectrum: Comprehensive Myocardium Motion Analysis with 3D Deep Learning and Geometric InsightsCode0
Free-SurGS: SfM-Free 3D Gaussian Splatting for Surgical Scene ReconstructionCode2
DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration ModelsCode2
What Matters in Detecting AI-Generated Videos like Sora?0
A Universal Railway Obstacle Detection System based on Semi-supervised Segmentation And Optical Flow0
Dense Monocular Motion Segmentation Using Optical Flow and Pseudo Depth Map: A Zero-Shot Approach0
Disentangled Motion Modeling for Video Frame InterpolationCode2
Splatter a Video: Video Gaussian Representation for Versatile Processing0
Low Latency Visual Inertial Odometry with On-Sensor Accelerated Optical Flow for Resource-Constrained UAVs0
MEDeA: Multi-view Efficient Depth Adjustment0
Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusion0
PLT-D3: A High-fidelity Dynamic Driving Simulation Dataset for Stereo Depth and Scene Flow0
Blur-aware Spatio-temporal Sparse Transformer for Video DeblurringCode2
Ada-VE: Training-Free Consistent Video Editing Using Adaptive Motion PriorCode0
A Semi-Self-Supervised Approach for Dense-Pattern Video Object Segmentation0
Reanimating Images using Neural Representations of Dynamic Stimuli0
DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentation0
Self-Calibrating 4D Novel View Synthesis from Monocular Videos Using Gaussian SplattingCode0
Enhancing Dynamic CT Image Reconstruction with Neural Fields and Optical Flow0
Synthetic Data Generation for 3D Myocardium Deformation AnalysisCode0
Prototypical Transformer as Unified Motion Learners0
EMAG: Ego-motion Aware and Generalizable 2D Hand Forecasting from Egocentric Videos0
May the Dance be with You: Dance Generation Framework for Non-Humanoids0
GFlow: Recovering 4D World from Monocular Video0
Flow-Assisted Motion Learning Network for Weakly-Supervised Group Activity Recognition0
SCSim: A Realistic Spike Cameras SimulatorCode0
DCPI-Depth: Explicitly Infusing Dense Correspondence Prior to Unsupervised Monocular Depth Estimation0
Show:102550
← PrevPage 6 of 44Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SpynetAverage End-Point Error6.64Unverified
2FastFlowNet-ftAverage End-Point Error4.89Unverified
3UnrolledCostAverage End-Point Error4.69Unverified
4LiteFlowNet-ftAverage End-Point Error4.54Unverified
5FlowNet2Average End-Point Error3.96Unverified
6IRR-PWCAverage End-Point Error3.84Unverified
7SelFlowAverage End-Point Error3.74Unverified
8FDFlowNet-ftAverage End-Point Error3.71Unverified
9ScopeFlowAverage End-Point Error3.59Unverified
10LiteFlowNet2-ftAverage End-Point Error3.48Unverified
#ModelMetricClaimedVerifiedStatus
1SpynetAverage End-Point Error8.36Unverified
2FastFlowNet-ftAverage End-Point Error6.08Unverified
3UnrolledCostAverage End-Point Error5.8Unverified
4MR-FlowAverage End-Point Error5.38Unverified
5LiteFlowNet-ftAverage End-Point Error5.38Unverified
6FDFlowNet-ftAverage End-Point Error5.11Unverified
7LiteFlowNet2-ftAverage End-Point Error4.69Unverified
8IRR-PWCAverage End-Point Error4.58Unverified
9LiteFlowNet3-SAverage End-Point Error4.53Unverified
10ContinualFlow + ftAverage End-Point Error4.52Unverified
#ModelMetricClaimedVerifiedStatus
1PWC-NetF1-all33.7Unverified
2FastFlowNetF1-all33.1Unverified
3FlowNet2F1-all30Unverified
4VCNF1-all25.1Unverified
5HD3F1-all24Unverified
6MaskFlowNetF1-all23.1Unverified
7SCVF1-all19.3Unverified
8RAPIDFlowF1-all17.7Unverified
9CRAFTF1-all17.5Unverified
10RAFTF1-all17.4Unverified
#ModelMetricClaimedVerifiedStatus
1FastFlowNet-ftFl-all11.22Unverified
2UnrolledCostFl-all10.81Unverified
3LiteFlowNet-ftFl-all9.38Unverified
4SelFlowFl-all8.42Unverified
5IRR-PWCFl-all7.65Unverified
6LiteFlowNet2-ftFl-all7.62Unverified
7LiteFlowNet3Fl-all7.34Unverified
8LiteFlowNet3-SFl-all7.22Unverified
9MaskFlownet-SFl-all6.81Unverified
10RAPIDFlowFl-all6.12Unverified
#ModelMetricClaimedVerifiedStatus
1FastFlowNet-ftAverage End-Point Error1.8Unverified
2LiteFlowNet-ftAverage End-Point Error1.6Unverified
3IRR-PWCAverage End-Point Error1.6Unverified
4SelFlowAverage End-Point Error1.5Unverified
5FDFlowNet-ftAverage End-Point Error1.5Unverified
6PWC-Net + ft - axXivAverage End-Point Error1.5Unverified
7LiteFlowNet2-ftAverage End-Point Error1.4Unverified
8LiteFlowNet3-SAverage End-Point Error1.3Unverified
9LiteFlowNet3Average End-Point Error1.3Unverified
10MaskFlownetAverage End-Point Error1.1Unverified
#ModelMetricClaimedVerifiedStatus
1PWCNet1px total82.27Unverified
2SPyNet1px total29.96Unverified
3GMFlow1px total10.36Unverified
4GMA1px total7.07Unverified
5RAFT1px total6.79Unverified
6FlowNet21px total6.71Unverified
7FlowFormer1px total6.51Unverified
8MS-RAFT+1px total5.72Unverified
9RPKNet1px total4.81Unverified
10DPFlow1px total3.44Unverified
#ModelMetricClaimedVerifiedStatus
1UFlowAverage End-Point Error5.21Unverified
2MDFlow-FastAverage End-Point Error4.73Unverified
3UpFlowAverage End-Point Error4.68Unverified
4ARFlow-MVAverage End-Point Error4.49Unverified
5MDFlowAverage End-Point Error4.16Unverified
#ModelMetricClaimedVerifiedStatus
1UFlowAverage End-Point Error6.5Unverified
2MDFlow-FastAverage End-Point Error5.99Unverified
3ARFlow-MVAverage End-Point Error5.67Unverified
4MDFlowAverage End-Point Error5.46Unverified
5UpFlowAverage End-Point Error5.32Unverified
#ModelMetricClaimedVerifiedStatus
1ARFlow-MVFl-all11.79Unverified
2MDFlow-FastFl-all11.43Unverified
3UpFlowFl-all9.38Unverified
4MDFlowFl-all8.91Unverified
#ModelMetricClaimedVerifiedStatus
1ARFlow-MVAverage End-Point Error1.5Unverified
2UpFlowAverage End-Point Error1.4Unverified