Optical Flow Estimation
Optical Flow Estimation is a computer vision task that involves computing the motion of objects in an image or a video sequence. The goal of optical flow estimation is to determine the movement of pixels or features in the image, which can be used for various applications such as object tracking, motion analysis, and video compression.
Approaches for optical flow estimation include correlation-based, block-matching, feature tracking, energy-based, and more recently gradient-based.
Further readings:
Definition source: Devon: Deformable Volume Network for Learning Optical Flow
Image credit: Optical Flow Estimation
Papers
Showing 1–25 of 2184 papers
All datasetsSintel-cleanSintel-finalKITTI 2015 (train)KITTI 2015KITTI 2012SpringSintel Clean unsupervisedSintel Final unsupervisedKITTI 2015 unsupervisedKITTI 2012 unsupervised
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Spynet | Average End-Point Error | 6.64 | — | Unverified |
| 2 | FastFlowNet-ft | Average End-Point Error | 4.89 | — | Unverified |
| 3 | UnrolledCost | Average End-Point Error | 4.69 | — | Unverified |
| 4 | LiteFlowNet-ft | Average End-Point Error | 4.54 | — | Unverified |
| 5 | FlowNet2 | Average End-Point Error | 3.96 | — | Unverified |
| 6 | IRR-PWC | Average End-Point Error | 3.84 | — | Unverified |
| 7 | SelFlow | Average End-Point Error | 3.74 | — | Unverified |
| 8 | FDFlowNet-ft | Average End-Point Error | 3.71 | — | Unverified |
| 9 | ScopeFlow | Average End-Point Error | 3.59 | — | Unverified |
| 10 | LiteFlowNet2-ft | Average End-Point Error | 3.48 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Spynet | Average End-Point Error | 8.36 | — | Unverified |
| 2 | FastFlowNet-ft | Average End-Point Error | 6.08 | — | Unverified |
| 3 | UnrolledCost | Average End-Point Error | 5.8 | — | Unverified |
| 4 | MR-Flow | Average End-Point Error | 5.38 | — | Unverified |
| 5 | LiteFlowNet-ft | Average End-Point Error | 5.38 | — | Unverified |
| 6 | FDFlowNet-ft | Average End-Point Error | 5.11 | — | Unverified |
| 7 | LiteFlowNet2-ft | Average End-Point Error | 4.69 | — | Unverified |
| 8 | IRR-PWC | Average End-Point Error | 4.58 | — | Unverified |
| 9 | LiteFlowNet3-S | Average End-Point Error | 4.53 | — | Unverified |
| 10 | ContinualFlow + ft | Average End-Point Error | 4.52 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | PWC-Net | F1-all | 33.7 | — | Unverified |
| 2 | FastFlowNet | F1-all | 33.1 | — | Unverified |
| 3 | FlowNet2 | F1-all | 30 | — | Unverified |
| 4 | VCN | F1-all | 25.1 | — | Unverified |
| 5 | HD3 | F1-all | 24 | — | Unverified |
| 6 | MaskFlowNet | F1-all | 23.1 | — | Unverified |
| 7 | SCV | F1-all | 19.3 | — | Unverified |
| 8 | RAPIDFlow | F1-all | 17.7 | — | Unverified |
| 9 | CRAFT | F1-all | 17.5 | — | Unverified |
| 10 | RAFT | F1-all | 17.4 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | FastFlowNet-ft | Fl-all | 11.22 | — | Unverified |
| 2 | UnrolledCost | Fl-all | 10.81 | — | Unverified |
| 3 | LiteFlowNet-ft | Fl-all | 9.38 | — | Unverified |
| 4 | SelFlow | Fl-all | 8.42 | — | Unverified |
| 5 | IRR-PWC | Fl-all | 7.65 | — | Unverified |
| 6 | LiteFlowNet2-ft | Fl-all | 7.62 | — | Unverified |
| 7 | LiteFlowNet3 | Fl-all | 7.34 | — | Unverified |
| 8 | LiteFlowNet3-S | Fl-all | 7.22 | — | Unverified |
| 9 | MaskFlownet-S | Fl-all | 6.81 | — | Unverified |
| 10 | RAPIDFlow | Fl-all | 6.12 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | FastFlowNet-ft | Average End-Point Error | 1.8 | — | Unverified |
| 2 | LiteFlowNet-ft | Average End-Point Error | 1.6 | — | Unverified |
| 3 | IRR-PWC | Average End-Point Error | 1.6 | — | Unverified |
| 4 | SelFlow | Average End-Point Error | 1.5 | — | Unverified |
| 5 | FDFlowNet-ft | Average End-Point Error | 1.5 | — | Unverified |
| 6 | PWC-Net + ft - axXiv | Average End-Point Error | 1.5 | — | Unverified |
| 7 | LiteFlowNet2-ft | Average End-Point Error | 1.4 | — | Unverified |
| 8 | LiteFlowNet3-S | Average End-Point Error | 1.3 | — | Unverified |
| 9 | LiteFlowNet3 | Average End-Point Error | 1.3 | — | Unverified |
| 10 | MaskFlownet | Average End-Point Error | 1.1 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | PWCNet | 1px total | 82.27 | — | Unverified |
| 2 | SPyNet | 1px total | 29.96 | — | Unverified |
| 3 | GMFlow | 1px total | 10.36 | — | Unverified |
| 4 | GMA | 1px total | 7.07 | — | Unverified |
| 5 | RAFT | 1px total | 6.79 | — | Unverified |
| 6 | FlowNet2 | 1px total | 6.71 | — | Unverified |
| 7 | FlowFormer | 1px total | 6.51 | — | Unverified |
| 8 | MS-RAFT+ | 1px total | 5.72 | — | Unverified |
| 9 | RPKNet | 1px total | 4.81 | — | Unverified |
| 10 | DPFlow | 1px total | 3.44 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | UFlow | Average End-Point Error | 5.21 | — | Unverified |
| 2 | MDFlow-Fast | Average End-Point Error | 4.73 | — | Unverified |
| 3 | UpFlow | Average End-Point Error | 4.68 | — | Unverified |
| 4 | ARFlow-MV | Average End-Point Error | 4.49 | — | Unverified |
| 5 | MDFlow | Average End-Point Error | 4.16 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | UFlow | Average End-Point Error | 6.5 | — | Unverified |
| 2 | MDFlow-Fast | Average End-Point Error | 5.99 | — | Unverified |
| 3 | ARFlow-MV | Average End-Point Error | 5.67 | — | Unverified |
| 4 | MDFlow | Average End-Point Error | 5.46 | — | Unverified |
| 5 | UpFlow | Average End-Point Error | 5.32 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ARFlow-MV | Fl-all | 11.79 | — | Unverified |
| 2 | MDFlow-Fast | Fl-all | 11.43 | — | Unverified |
| 3 | UpFlow | Fl-all | 9.38 | — | Unverified |
| 4 | MDFlow | Fl-all | 8.91 | — | Unverified |