SOTAVerified

Quantization

Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).

Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers

Papers

Showing 22512300 of 4925 papers

TitleStatusHype
A Cost-Efficient FPGA Implementation of Tiny Transformer Model using Neural ODE0
Enhancing Generalization of Invisible Facial Privacy Cloak via Gradient Accumulation0
Model-Free Learning for the Linear Quadratic Regulator over Rate-Limited Channels0
General Point Model Pretraining with Autoencoding and AutoregressiveCode0
Are Conventional SNNs Really Efficient? A Perspective from Network Quantization0
Reg-PTQ: Regression-specialized Post-training Quantization for Fully Quantized Object Detector0
Enhancing Post-training Quantization Calibration through Contrastive Learning0
PredToken: Predicting Unknown Tokens and Beyond with Coarse-to-Fine Iterative Decoding0
PikeLPN: Mitigating Overlooked Inefficiencies of Low-Precision Neural Networks0
Data-Free Quantization via Pseudo-label Filtering0
HQ-VAE: Hierarchical Discrete Representation Learning with Variational Bayes0
Compact Neural Graphics Primitives with Learned Hash Probing0
FALCON: Feature-Label Constrained Graph Net Collapse for Memory Efficient GNNsCode0
A-SDM: Accelerating Stable Diffusion through Redundancy Removal and Performance Optimization0
Efficient Asynchronous Federated Learning with Sparsification and Quantization0
Hardware-Aware DNN Compression via Diverse Pruning and Mixed-Precision Quantization0
Cross-Layer Optimization for Fault-Tolerant Deep Learning0
Fed-QSSL: A Framework for Personalized Federated Learning under Bitwidth and Data HeterogeneityCode0
Towards Efficient Verification of Quantized Neural NetworksCode0
Find the Lady: Permutation and Re-Synchronization of Deep Neural NetworksCode0
SimQ-NAS: Simultaneous Quantization Policy and Neural Architecture Search0
Power-Efficient Sampling0
Quantized Decoder in Learned Image Compression for Deterministic Reconstruction0
Post-Training Quantization for Re-parameterization via Coarse & Fine Weight SplittingCode0
SPT: Fine-Tuning Transformer-based Language Models Efficiently with SparsificationCode0
IQNet: Image Quality Assessment Guided Just Noticeable Difference Prefiltering For Versatile Video Coding0
Adaptive Computation Modules: Granular Conditional Computation For Efficient InferenceCode0
Design Space Exploration of Low-Bit Quantized Neural Networks for Visual Place Recognition0
USM-Lite: Quantization and Sparsity Aware Fine-tuning for Speech Recognition with Universal Speech Models0
CBQ: Cross-Block Quantization for Large Language Models0
When Bio-Inspired Computing meets Deep Learning: Low-Latency, Accurate, & Energy-Efficient Spiking Neural Networks from Artificial Neural Networks0
Expand-and-Quantize: Unsupervised Semantic Segmentation Using High-Dimensional Space and Product Quantization0
IDKM: Memory Efficient Neural Network Quantization via Implicit, Differentiable k-Means0
Decoupling Meta-Reinforcement Learning with Gaussian Task Contexts and SkillsCode0
FP8-BERT: Post-Training Quantization for Transformer0
QMGeo: Differentially Private Federated Learning via Stochastic Quantization with Mixed Truncated Geometric Distribution0
Neural Architecture Codesign for Fast Bragg Peak Analysis0
Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the EdgeCode0
Efficient Quantization Strategies for Latent Diffusion Models0
Automotive Radar Sensing with Sparse Linear Arrays Using One-Bit Hankel Matrix Completion0
Understanding the Effect of Model Compression on Social Bias in Large Language ModelsCode0
An Experimental Study: Assessing the Combined Framework of WavLM and BEST-RQ for Text-to-Speech Synthesis0
GenQ: Quantization in Low Data Regimes with Generative Synthetic DataCode0
Rate-splitting Multiple Access for Hierarchical HAP-LAP Networks under Limited Fronthaul0
Enhancing Kinship Verification through Multiscale Retinex and Combined Deep-Shallow features0
All Rivers Run to the Sea: Private Learning with Asymmetric Flows0
Unified learning-based lossy and lossless JPEG recompression0
PLUM: Improving Inference Efficiency By Leveraging Repetition-Sparsity Trade-OffCode0
Low-Precision Mixed-Computation Models for Inference on Edge0
QuantAttack: Exploiting Dynamic Quantization to Attack Vision TransformersCode0
Show:102550
← PrevPage 46 of 99Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1FQ-ViT (ViT-L)Top-1 Accuracy (%)85.03Unverified
2FQ-ViT (ViT-B)Top-1 Accuracy (%)83.31Unverified
3FQ-ViT (Swin-B)Top-1 Accuracy (%)82.97Unverified
4FQ-ViT (Swin-S)Top-1 Accuracy (%)82.71Unverified
5FQ-ViT (DeiT-B)Top-1 Accuracy (%)81.2Unverified
6FQ-ViT (Swin-T)Top-1 Accuracy (%)80.51Unverified
7FQ-ViT (DeiT-S)Top-1 Accuracy (%)79.17Unverified
8Xception W8A8Top-1 Accuracy (%)78.97Unverified
9ADLIK-MO-ResNet50-W4A4Top-1 Accuracy (%)77.88Unverified
10ADLIK-MO-ResNet50-W3A4Top-1 Accuracy (%)77.34Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_3MAP160,327.04Unverified
2DTQMAP0.79Unverified
#ModelMetricClaimedVerifiedStatus
1OutEffHop-Bert_basePerplexity6.3Unverified
2OutEffHop-Bert_basePerplexity6.21Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy98.13Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy92.92Unverified
#ModelMetricClaimedVerifiedStatus
1SSD ResNet50 V1 FPN 640x640MAP34.3Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-495.13Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-496.38Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_5All84,809,664Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy99.8Unverified