Video Enhancement with Task-Oriented Flow

Code

• github.com/laomao0/BIN
  pytorch★ 216
• github.com/anchen1011/toflow
  torch★ 0
• github.com/Coldog2333/pytoflow
  pytorch★ 0
• github.com/jcao216/DAIN_Modified
  pytorch★ 0

Abstract

Many video enhancement algorithms rely on optical flow to register frames in a video sequence. Precise flow estimation is however intractable; and optical flow itself is often a sub-optimal representation for particular video processing tasks. In this paper, we propose task-oriented flow (TOFlow), a motion representation learned in a self-supervised, task-specific manner. We design a neural network with a trainable motion estimation component and a video processing component, and train them jointly to learn the task-oriented flow. For evaluation, we build Vimeo-90K, a large-scale, high-quality video dataset for low-level video processing. TOFlow outperforms traditional optical flow on standard benchmarks as well as our Vimeo-90K dataset in three video processing tasks: frame interpolation, video denoising/deblocking, and video super-resolution.

Tasks

Benchmark Results

Reproductions