SOTAVerified

Quantization

Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).

Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers

Papers

Showing 33013325 of 4925 papers

TitleStatusHype
Discrete-Valued Neural Communication0
Multi-modality Deep Restoration of Extremely Compressed Face Videos0
Q-SpiNN: A Framework for Quantizing Spiking Neural Networks0
Exact Backpropagation in Binary Weighted Networks with Group Weight TransformationsCode0
BAGUA: Scaling up Distributed Learning with System RelaxationsCode1
A Lottery Ticket Hypothesis Framework for Low-Complexity Device-Robust Neural Acoustic Scene Classification0
Secure Quantized Training for Deep LearningCode1
Orthonormal Product Quantization Network for Scalable Face Image RetrievalCode0
Power Law Graph Transformer for Machine Translation and Representation LearningCode0
Post-Training Quantization for Vision Transformer0
LNS-Madam: Low-Precision Training in Logarithmic Number System using Multiplicative Weight Update0
PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation0
Preliminary study on using vector quantization latent spaces for TTS/VC systems with consistent performance0
Countering Adversarial Examples: Combining Input Transformation and Noisy Training0
Transform-Based Feature Map Compression for CNN Inference0
Quantization Aware Training, ERNIE and Kurtosis Regularizer: a short empirical study0
APNN-TC: Accelerating Arbitrary Precision Neural Networks on Ampere GPU Tensor CoresCode1
On Minimizing Symbol Error Rate Over Fading Channels with Low-Resolution Quantization0
Over-the-Air Computation via Cloud Radio Access Networks0
Witten-type topological field theory of self-organized criticality for stochastic neural networks0
Efficient Inference via Universal LSH Kernel0
Tensor Learning-based Precoder Codebooks for FD-MIMO Systems0
Communication Efficient SGD via Gradient Sampling With Bayes Prior0
QPP: Real-Time Quantization Parameter Prediction for Deep Neural Networks0
Event-Based Bispectral Photometry Using Temporally Modulated Illumination0
Show:102550
← PrevPage 133 of 197Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1FQ-ViT (ViT-L)Top-1 Accuracy (%)85.03Unverified
2FQ-ViT (ViT-B)Top-1 Accuracy (%)83.31Unverified
3FQ-ViT (Swin-B)Top-1 Accuracy (%)82.97Unverified
4FQ-ViT (Swin-S)Top-1 Accuracy (%)82.71Unverified
5FQ-ViT (DeiT-B)Top-1 Accuracy (%)81.2Unverified
6FQ-ViT (Swin-T)Top-1 Accuracy (%)80.51Unverified
7FQ-ViT (DeiT-S)Top-1 Accuracy (%)79.17Unverified
8Xception W8A8Top-1 Accuracy (%)78.97Unverified
9ADLIK-MO-ResNet50-W4A4Top-1 Accuracy (%)77.88Unverified
10ADLIK-MO-ResNet50-W3A4Top-1 Accuracy (%)77.34Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_3MAP160,327.04Unverified
2DTQMAP0.79Unverified
#ModelMetricClaimedVerifiedStatus
1OutEffHop-Bert_basePerplexity6.3Unverified
2OutEffHop-Bert_basePerplexity6.21Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy98.13Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy92.92Unverified
#ModelMetricClaimedVerifiedStatus
1SSD ResNet50 V1 FPN 640x640MAP34.3Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-495.13Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-496.38Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_5All84,809,664Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy99.8Unverified