SOTAVerified

Optical Flow Estimation

Optical Flow Estimation is a computer vision task that involves computing the motion of objects in an image or a video sequence. The goal of optical flow estimation is to determine the movement of pixels or features in the image, which can be used for various applications such as object tracking, motion analysis, and video compression.

Approaches for optical flow estimation include correlation-based, block-matching, feature tracking, energy-based, and more recently gradient-based.

Further readings:

Definition source: Devon: Deformable Volume Network for Learning Optical Flow

Image credit: Optical Flow Estimation

Papers

Showing 651700 of 2184 papers

TitleStatusHype
BlinkVision: A Benchmark for Optical Flow, Scene Flow and Point Tracking Estimation using RGB Frames and Events0
Robust Optical Flow Computation: A Higher-Order Differential Approach0
Z-upscaling: Optical Flow Guided Frame Interpolation for Isotropic Reconstruction of 3D EM VolumesCode0
Future frame prediction in chest cine MR imaging using the PCA respiratory motion model and dynamically trained recurrent neural networks0
Descriptor: Face Detection Dataset for Programmable Threshold-Based Sparse-VisionCode0
DressRecon: Freeform 4D Human Reconstruction from Monocular Video0
TFS-NeRF: Template-Free NeRF for Semantic 3D Reconstruction of Dynamic SceneCode0
Subjective and Objective Quality-of-Experience Evaluation Study for Live Video Streaming0
EventHDR: from Event to High-Speed HDR Videos and Beyond0
Adverse Weather Optical Flow: Cumulative Homogeneous-Heterogeneous Adaptation0
Pose-Guided Fine-Grained Sign Language Video Generation0
Skills Made to Order: Efficient Acquisition of Robot Cooking Skills Guided by Multiple Forms of Internet Data0
Secrets of Edge-Informed Contrast Maximization for Event-Based Vision0
Optical Flow Matters: an Empirical Comparative Study on Fusing Monocular Extracted Modalities for Better Steering0
Training Datasets Generation for Machine Learning: Application to Vision Based Navigation0
Multimodal Attention-Enhanced Feature Fusion-based Weekly Supervised Anomaly Violence Detection0
Continual Learning of Conjugated Visual Representations through Higher-order Motion Flows0
SHIRE: Enhancing Sample Efficiency using Human Intuition in REinforcement Learning0
Tracking Virtual Meetings in the Wild: Re-identification in Multi-Participant Virtual Meetings0
InstantDrag: Improving Interactivity in Drag-based Image Editing0
Violence detection in videos using deep recurrent and convolutional neural networks0
Neuromorphic spatiotemporal optical flow: Enabling ultrafast visual perception beyond human capabilities0
Real-Time Human Action Recognition on Embedded Platforms0
LayeredFlow: A Real-World Benchmark for Non-Lambertian Multi-Layer Optical Flow0
HMAFlow: Learning More Accurate Optical Flow via Hierarchical Motion Field AlignmentCode0
FlowRetrieval: Flow-Guided Data Retrieval for Few-Shot Imitation LearningCode0
Estimating Dynamic Flow Features in Groups of Tracked Objects0
Video Diffusion Models are Strong Video Inpainter0
DemMamba: Alignment-free Raw Video Demoireing with Frequency-assisted Spatio-Temporal Mamba0
PooDLe: Pooled and dense self-supervised learning from naturalistic videos0
OPPH: A Vision-Based Operator for Measuring Body Movements for Personal Healthcare0
CoSEC: A Coaxial Stereo Event Camera Dataset for Autonomous Driving0
MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editing0
Toward Pedestrian Head Tracking: A Benchmark Dataset and an Information Fusion Network0
Egocentric Vision Language Planning0
KOI: Accelerating Online Imitation Learning via Hybrid Key-state Guidance0
NOLO: Navigate Only Look Once0
EMatch: A Unified Framework for Event-based Optical Flow and Stereo Matching0
SpotFormer: Multi-Scale Spatio-Temporal Transformer for Facial Expression Spotting0
Event-based Optical Flow on Neuromorphic Processor: ANN vs. SNN Comparison based on Activation SparsificationCode0
Revisit Event Generation Model: Self-Supervised Learning of Event-to-Video Reconstruction with Implicit Neural Representations0
Occlusion-Aware 3D Motion Interpretation for Abnormal Behavior Detection0
Real-Time Image Analysis Software Suitable for Resource-Constrained ComputingCode0
Attenuation-Aware Weighted Optical Flow with Medium Transmission Map for Learning-based Visual Odometry in Underwater terrainCode0
Many Perception Tasks are Highly Redundant Functions of their Input Data0
Fusion Flow-enhanced Graph Pooling Residual Networks for Unmanned Aerial Vehicles Surveillance in Day and Night Dual Visions0
Improving Unsupervised Video Object Segmentation via Fake Flow Generation0
Comparing Optical Flow and Deep Learning to Enable Computationally Efficient Traffic Event Detection with Space-Filling Curves0
Research Experience of an Undergraduate Student in Computer Vision and Robotics0
Event-based vision on FPGAs -- a survey0
Show:102550
← PrevPage 14 of 44Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SpynetAverage End-Point Error6.64Unverified
2FastFlowNet-ftAverage End-Point Error4.89Unverified
3UnrolledCostAverage End-Point Error4.69Unverified
4LiteFlowNet-ftAverage End-Point Error4.54Unverified
5FlowNet2Average End-Point Error3.96Unverified
6IRR-PWCAverage End-Point Error3.84Unverified
7SelFlowAverage End-Point Error3.74Unverified
8FDFlowNet-ftAverage End-Point Error3.71Unverified
9ScopeFlowAverage End-Point Error3.59Unverified
10LiteFlowNet2-ftAverage End-Point Error3.48Unverified
#ModelMetricClaimedVerifiedStatus
1SpynetAverage End-Point Error8.36Unverified
2FastFlowNet-ftAverage End-Point Error6.08Unverified
3UnrolledCostAverage End-Point Error5.8Unverified
4MR-FlowAverage End-Point Error5.38Unverified
5LiteFlowNet-ftAverage End-Point Error5.38Unverified
6FDFlowNet-ftAverage End-Point Error5.11Unverified
7LiteFlowNet2-ftAverage End-Point Error4.69Unverified
8IRR-PWCAverage End-Point Error4.58Unverified
9LiteFlowNet3-SAverage End-Point Error4.53Unverified
10ContinualFlow + ftAverage End-Point Error4.52Unverified
#ModelMetricClaimedVerifiedStatus
1PWC-NetF1-all33.7Unverified
2FastFlowNetF1-all33.1Unverified
3FlowNet2F1-all30Unverified
4VCNF1-all25.1Unverified
5HD3F1-all24Unverified
6MaskFlowNetF1-all23.1Unverified
7SCVF1-all19.3Unverified
8RAPIDFlowF1-all17.7Unverified
9CRAFTF1-all17.5Unverified
10RAFTF1-all17.4Unverified
#ModelMetricClaimedVerifiedStatus
1FastFlowNet-ftFl-all11.22Unverified
2UnrolledCostFl-all10.81Unverified
3LiteFlowNet-ftFl-all9.38Unverified
4SelFlowFl-all8.42Unverified
5IRR-PWCFl-all7.65Unverified
6LiteFlowNet2-ftFl-all7.62Unverified
7LiteFlowNet3Fl-all7.34Unverified
8LiteFlowNet3-SFl-all7.22Unverified
9MaskFlownet-SFl-all6.81Unverified
10RAPIDFlowFl-all6.12Unverified
#ModelMetricClaimedVerifiedStatus
1FastFlowNet-ftAverage End-Point Error1.8Unverified
2LiteFlowNet-ftAverage End-Point Error1.6Unverified
3IRR-PWCAverage End-Point Error1.6Unverified
4SelFlowAverage End-Point Error1.5Unverified
5FDFlowNet-ftAverage End-Point Error1.5Unverified
6PWC-Net + ft - axXivAverage End-Point Error1.5Unverified
7LiteFlowNet2-ftAverage End-Point Error1.4Unverified
8LiteFlowNet3-SAverage End-Point Error1.3Unverified
9LiteFlowNet3Average End-Point Error1.3Unverified
10MaskFlownetAverage End-Point Error1.1Unverified
#ModelMetricClaimedVerifiedStatus
1PWCNet1px total82.27Unverified
2SPyNet1px total29.96Unverified
3GMFlow1px total10.36Unverified
4GMA1px total7.07Unverified
5RAFT1px total6.79Unverified
6FlowNet21px total6.71Unverified
7FlowFormer1px total6.51Unverified
8MS-RAFT+1px total5.72Unverified
9RPKNet1px total4.81Unverified
10DPFlow1px total3.44Unverified
#ModelMetricClaimedVerifiedStatus
1UFlowAverage End-Point Error5.21Unverified
2MDFlow-FastAverage End-Point Error4.73Unverified
3UpFlowAverage End-Point Error4.68Unverified
4ARFlow-MVAverage End-Point Error4.49Unverified
5MDFlowAverage End-Point Error4.16Unverified
#ModelMetricClaimedVerifiedStatus
1UFlowAverage End-Point Error6.5Unverified
2MDFlow-FastAverage End-Point Error5.99Unverified
3ARFlow-MVAverage End-Point Error5.67Unverified
4MDFlowAverage End-Point Error5.46Unverified
5UpFlowAverage End-Point Error5.32Unverified
#ModelMetricClaimedVerifiedStatus
1ARFlow-MVFl-all11.79Unverified
2MDFlow-FastFl-all11.43Unverified
3UpFlowFl-all9.38Unverified
4MDFlowFl-all8.91Unverified
#ModelMetricClaimedVerifiedStatus
1ARFlow-MVAverage End-Point Error1.5Unverified
2UpFlowAverage End-Point Error1.4Unverified