SOTAVerified

VideoPatchCore: An Effective Method to Memorize Normality for Video Anomaly Detection

2024-09-24Code Available1· sign in to hype

Sunghyun Ahn, Youngwan Jo, Kijung Lee, Sanghyun Park

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Video anomaly detection (VAD) is a crucial task in video analysis and surveillance within computer vision. Currently, VAD is gaining attention with memory techniques that store the features of normal frames. The stored features are utilized for frame reconstruction, identifying an abnormality when a significant difference exists between the reconstructed and input frames. However, this approach faces several challenges due to the simultaneous optimization required for both the memory and encoder-decoder model. These challenges include increased optimization difficulty, complexity of implementation, and performance variability depending on the memory size. To address these challenges,we propose an effective memory method for VAD, called VideoPatchCore. Inspired by PatchCore, our approach introduces a structure that prioritizes memory optimization and configures three types of memory tailored to the characteristics of video data. This method effectively addresses the limitations of existing memory-based methods, achieving good performance comparable to state-of-the-art methods. Furthermore, our method requires no training and is straightforward to implement, making VAD tasks more accessible. Our code is available online at github.com/SkiddieAhn/Paper-VideoPatchCore.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CUHK AvenueVideoPatchCoreAUC92.8Unverified
IITB CorridorVideoPatchCoreAUC76.4Unverified
ShanghaiTechVideoPatchCoreAUC85.1Unverified

Reproductions