Detecting Persuasive Atypicality by Modeling Contextual Compatibility

Code

• github.com/meiqiguo/iccv2021-atypicalitydetection
  OfficialIn paperpytorch★ 4

Abstract

We propose a new approach to detect atypicality in persuasive imagery. Unlike atypicality which has been studied in prior work, persuasive atypicality has a particular purpose to convey meaning, and relies on understanding the common-sense spatial relations of objects. We propose a self-supervised attention-based technique which captures contextual compatibility, and models spatial relations in a precise manner. We further experiment with capturing common sense through the semantics of co-occurring object classes. We verify our approach on a dataset of atypicality in visual advertisements, as well as a second dataset capturing atypicality that has no persuasive intent.

Tasks

Reproductions