SOTAVerified

Quantization

Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).

Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers

Papers

Showing 33013350 of 4925 papers

TitleStatusHype
Discrete-Valued Neural Communication0
Multi-modality Deep Restoration of Extremely Compressed Face Videos0
Q-SpiNN: A Framework for Quantizing Spiking Neural Networks0
Exact Backpropagation in Binary Weighted Networks with Group Weight TransformationsCode0
BAGUA: Scaling up Distributed Learning with System RelaxationsCode1
A Lottery Ticket Hypothesis Framework for Low-Complexity Device-Robust Neural Acoustic Scene Classification0
Secure Quantized Training for Deep LearningCode1
Orthonormal Product Quantization Network for Scalable Face Image RetrievalCode0
Power Law Graph Transformer for Machine Translation and Representation LearningCode0
Post-Training Quantization for Vision Transformer0
LNS-Madam: Low-Precision Training in Logarithmic Number System using Multiplicative Weight Update0
PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation0
Preliminary study on using vector quantization latent spaces for TTS/VC systems with consistent performance0
Countering Adversarial Examples: Combining Input Transformation and Noisy Training0
Transform-Based Feature Map Compression for CNN Inference0
Quantization Aware Training, ERNIE and Kurtosis Regularizer: a short empirical study0
APNN-TC: Accelerating Arbitrary Precision Neural Networks on Ampere GPU Tensor CoresCode1
On Minimizing Symbol Error Rate Over Fading Channels with Low-Resolution Quantization0
Over-the-Air Computation via Cloud Radio Access Networks0
Witten-type topological field theory of self-organized criticality for stochastic neural networks0
Efficient Inference via Universal LSH Kernel0
Tensor Learning-based Precoder Codebooks for FD-MIMO Systems0
Communication Efficient SGD via Gradient Sampling With Bayes Prior0
QPP: Real-Time Quantization Parameter Prediction for Deep Neural Networks0
Event-Based Bispectral Photometry Using Temporally Modulated Illumination0
Automated Log-Scale Quantization for Low-Cost Deep Neural Networks0
Optimal Quantization Using Scaled Codebook0
Distribution-Aware Adaptive Multi-Bit Quantization0
Deep Perceptual Preprocessing for Video Coding0
PVGNet: A Bottom-Up One-Stage 3D Object Detector With Integrated Multi-Level Features0
Effects of VLSI Circuit Constraints on Temporal-Coding Multilayer Spiking Neural Networks0
Light Lies: Optical Adversarial Attack0
VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice ConversionCode1
On Effects of Compression with Hyperdimensional Computing in Distributed Randomized Neural Networks0
Unsupervised classification of cell imaging data using the quantization error in a Self Organizing Map0
Generalized Learning Vector Quantization for Classification in Randomized Neural Networks and Hyperdimensional ComputingCode0
Quantized Federated Learning under Transmission Delay and Outage Constraints0
Development of Quantized DNN Library for Exact Hardware Emulation0
Divergence Frontiers for Generative Models: Sample Complexity, Quantization Effects, and Frontier IntegralsCode0
A White Paper on Neural Network Quantization0
Compositional Sketch SearchCode0
FastICARL: Fast Incremental Classifier and Representation Learning with Efficient Budget Allocation in Audio Sensing Applications0
Energy-efficient Knowledge Distillation for Spiking Neural Networks0
Neuroevolution-Enhanced Multi-Objective Optimization for Mixed-Precision Quantization0
On the Convergence of Differentially Private Federated Learning on Non-Lipschitz Objectives, and with Normalized Client Updates0
AI Enlightens Wireless Communication: Analyses, Solutions and Opportunities on CSI Feedback0
Decoupled Greedy Learning of CNNs for Synchronous and Asynchronous Distributed Learning0
Cross-Modal Discrete Representation Learning0
Fastening the Initial Access in 5G NR Sidelink for 6G V2X Networks0
SignalNet: A Low Resolution Sinusoid Decomposition and Estimation Network0
Show:102550
← PrevPage 67 of 99Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1FQ-ViT (ViT-L)Top-1 Accuracy (%)85.03Unverified
2FQ-ViT (ViT-B)Top-1 Accuracy (%)83.31Unverified
3FQ-ViT (Swin-B)Top-1 Accuracy (%)82.97Unverified
4FQ-ViT (Swin-S)Top-1 Accuracy (%)82.71Unverified
5FQ-ViT (DeiT-B)Top-1 Accuracy (%)81.2Unverified
6FQ-ViT (Swin-T)Top-1 Accuracy (%)80.51Unverified
7FQ-ViT (DeiT-S)Top-1 Accuracy (%)79.17Unverified
8Xception W8A8Top-1 Accuracy (%)78.97Unverified
9ADLIK-MO-ResNet50-W4A4Top-1 Accuracy (%)77.88Unverified
10ADLIK-MO-ResNet50-W3A4Top-1 Accuracy (%)77.34Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_3MAP160,327.04Unverified
2DTQMAP0.79Unverified
#ModelMetricClaimedVerifiedStatus
1OutEffHop-Bert_basePerplexity6.3Unverified
2OutEffHop-Bert_basePerplexity6.21Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy98.13Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy92.92Unverified
#ModelMetricClaimedVerifiedStatus
1SSD ResNet50 V1 FPN 640x640MAP34.3Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-495.13Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-496.38Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_5All84,809,664Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy99.8Unverified