Array Camera Image Fusion using Physics-Aware Transformers

Code

• github.com/djbradyatopticalsciencesarizona/physicsawaretransformer
  OfficialIn paperpytorch★ 5

Abstract

We demonstrate a physics-aware transformer for feature-based data fusion from cameras with diverse resolution, color spaces, focal planes, focal lengths, and exposure. We also demonstrate a scalable solution for synthetic training data generation for the transformer using open-source computer graphics software. We demonstrate image synthesis on arrays with diverse spectral responses, instantaneous field of view and frame rate.

Tasks

Reproductions