SOTAVerified

Quantization

Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).

Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers

Papers

Showing 28512900 of 4925 papers

TitleStatusHype
Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense Representations0
Sparse Quantization for Patch Description0
Sparse Quantized Spectral Clustering0
Sparse-SignSGD with Majority Vote for Communication-Efficient Distributed Learning0
Sparse-VQ Transformer: An FFN-Free Framework with Vector Quantization for Enhanced Time Series Forecasting0
Sparsification via Compressed Sensing for Automatic Speech Recognition0
Sparsifying Binary Networks0
Spatial Sigma-Delta Modulation for Coarsely Quantized Massive MIMO Downlink: Flexible Designs by Convex Optimization0
Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidance0
Spatio-Temporal Pruning and Quantization for Low-latency Spiking Neural Networks0
SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning0
SPC-NeRF: Spatial Predictive Compression for Voxel Based Radiance Field0
Speaker Diaphragm Excursion Prediction: deep attention and online adaptation0
Speaker Identification From Youtube Obtained Data0
SpeCache: Speculative Key-Value Caching for Efficient Generation of LLMs0
SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting0
Specialized Transformers: Faster, Smaller and more Accurate NLP Models0
Non-asymptotic spectral bounds on the -entropy of kernel classes0
Spectral Clustering with Perturbed Data0
Spectral Codecs: Improving Non-Autoregressive Speech Synthesis with Spectrogram-Based Audio Codecs0
Spectral-PQ: A Novel Spectral Sensitivity-Orientated Perceptual Compression Technique for RGB 4:4:4 Video Data0
Speculative Decoding and Beyond: An In-Depth Review of Techniques0
Speech Enhancement Using Continuous Embeddings of Neural Audio Codec0
Speech Enhancement Using Self-Supervised Pre-Trained Model and Vector Quantization0
Speech Enhancement with Multi-granularity Vector Quantization0
Speed Is All You Need: On-Device Acceleration of Large Diffusion Models via GPU-Aware Optimizations0
Speedup deep learning models on GPU by taking advantage of efficient unstructured pruning and bit-width reduction0
SPFQ: A Stochastic Algorithm and Its Error Analysis for Neural Network Quantization0
SPIQ: Data-Free Per-Channel Static Input Quantization0
SplitQuant: Layer Splitting for Low-Bit Neural Network Quantization0
SQ-DM: Accelerating Diffusion Models with Aggressive Quantization and Temporal Sparsity0
sqSGD: Locally Private and Communication Efficient Federated Learning0
SQuantizer: Simultaneous Learning for Both Sparse and Low-precision Neural Networks0
SQuAT: Sharpness- and Quantization-Aware Training for BERT0
SQuat: Subspace-orthogonal KV Cache Quantization0
SQWA: Stochastic Quantized Weight Averaging for Improving the Generalization Capability of Low-Precision Deep Neural Networks0
Stability Analysis of Various Symbolic Rule Extraction Methods from Recurrent Neural Network0
Stabilization of an unstable reaction-diffusion PDE with input delay despite state and input quantization0
Stabilizing Quantization-Aware Training by Implicit-Regularization on Hessian Matrix0
StableQuant: Layer Adaptive Post-Training Quantization for Speech Foundation Models0
Stacked Denoising Autoencoders and Transfer Learning for Immunogold Particles Detection and Recognition0
StainPIDR: A Pathological Image Decouplingand Reconstruction Method for Stain Normalization Based on Color Vector Quantization and Structure Restaining0
Standard Deviation-Based Quantization for Deep Neural Networks0
STanH : Parametric Quantization for Variable Rate Learned Image Compression0
State Machine-based Waveforms for Channels With 1-Bit Quantization and Oversampling With Time-Instance Zero-Crossing Modulation0
Static Quantized Radix-2 FFT/IFFT Processor for Constraints Analysis0
Statistical Model Compression for Small-Footprint Natural Language Understanding0
Statistical Modeling of Soft Error Influence on Neural Networks0
STDP Based Pruning of Connections and Weight Quantization in Spiking Neural Networks for Energy Efficient Recognition0
STEPS: Sequential Probability Tensor Estimation for Text-to-Image Hard Prompt Search0
Show:102550
← PrevPage 58 of 99Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1FQ-ViT (ViT-L)Top-1 Accuracy (%)85.03Unverified
2FQ-ViT (ViT-B)Top-1 Accuracy (%)83.31Unverified
3FQ-ViT (Swin-B)Top-1 Accuracy (%)82.97Unverified
4FQ-ViT (Swin-S)Top-1 Accuracy (%)82.71Unverified
5FQ-ViT (DeiT-B)Top-1 Accuracy (%)81.2Unverified
6FQ-ViT (Swin-T)Top-1 Accuracy (%)80.51Unverified
7FQ-ViT (DeiT-S)Top-1 Accuracy (%)79.17Unverified
8Xception W8A8Top-1 Accuracy (%)78.97Unverified
9ADLIK-MO-ResNet50-W4A4Top-1 Accuracy (%)77.88Unverified
10ADLIK-MO-ResNet50-W3A4Top-1 Accuracy (%)77.34Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_3MAP160,327.04Unverified
2DTQMAP0.79Unverified
#ModelMetricClaimedVerifiedStatus
1OutEffHop-Bert_basePerplexity6.3Unverified
2OutEffHop-Bert_basePerplexity6.21Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy98.13Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy92.92Unverified
#ModelMetricClaimedVerifiedStatus
1SSD ResNet50 V1 FPN 640x640MAP34.3Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-495.13Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-496.38Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_5All84,809,664Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy99.8Unverified