SOTAVerified

CLCNet: Rethinking of Ensemble Modeling with Classification Confidence Network

2022-05-19Code Available1· sign in to hype

Yao-Ching Yu, Shi-Jinn Horng

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

In this paper, we propose a Classification Confidence Network (CLCNet) that can determine whether the classification model classifies input samples correctly. It can take a classification result in the form of vector in any dimension, and return a confidence score as output, which represents the probability of an instance being classified correctly. We can utilize CLCNet in a simple cascade structure system consisting of several SOTA (state-of-the-art) classification models, and our experiments show that the system can achieve the following advantages: 1. The system can customize the average computation requirement (FLOPs) per image while inference. 2. Under the same computation requirement, the performance of the system can exceed any model that has identical structure with the model in the system, but different in size. In fact, this is a new type of ensemble modeling. Like general ensemble modeling, it can achieve higher performance than single classification model, yet our system requires much less computation than general ensemble modeling. We have uploaded our code to a github repository: https://github.com/yaoching0/CLCNet-Rethinking-of-Ensemble-Modeling.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
ImageNetCLCNet (S:ViT+D:EffNet-B7) (retrain)Top 1 Accuracy86.61Unverified
ImageNetCLCNet (S:ViT+D:VOLO-D3) (retrain)Top 1 Accuracy86.46Unverified
ImageNetCLCNet (S:ConvNeXt-L+D:EffNet-B7) (retrain)Top 1 Accuracy86.42Unverified
ImageNetCLCNet (S:D1+D:D5)Top 1 Accuracy85.28Unverified
ImageNetCLCNet (S:B4+D:B7)Top 1 Accuracy83.88Unverified

Reproductions