SOTAVerified

Quantization

Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).

Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1801–1850 of 4925 papers

TitleStatusHype
UniMoT: Unified Molecule-Text Language Model with Discrete Token Representation—0
CDFGNN: a Systematic Design of Cache-based Distributed Full-Batch Graph Neural Network Training with Communication Reduction—0
A Simple Low-bit Quantization Framework for Video Snapshot Compressive ImagingCode0
Exploiting Change Blindness for Video Coding: Perspectives from a Less Promising User Study—0
On the Perturbed States for Transformed Input-robust Reinforcement LearningCode0
Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval—0
Abstractive summarization from Audio Transcription—0
ThinK: Thinner Key Cache by Query-Driven Pruning—0
Model Agnostic Hybrid Sharding For Heterogeneous Distributed Inference—0
MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity—0
The Interpretability of Codebooks in Model-Based Reinforcement Learning is Limited—0
Reputation-Driven Asynchronous Federated Learning for Enhanced Trajectory Prediction with Blockchain—0
Mixed Non-linear Quantization for Vision TransformersCode0
Unlocking Tokens as Data Points for Generalization Bounds on Larger Language Models—0
Quasar-ViT: Hardware-Oriented Quantization-Aware Architecture Search for Vision Transformers—0
Accurate and Efficient Fine-Tuning of Quantized Large Language Models Through Optimal BalanceCode0
Low dimensional representation of multi-patient flow cytometry datasets using optimal transport for minimal residual disease detection in leukemiaCode0
Pixel Embedding: Fully Quantized Convolutional Neural Network with Differentiable Lookup Table—0
Comprehensive Study on Performance Evaluation and Optimization of Model Compression: Bridging Traditional Deep Learning and Large Language Models—0
Compensate Quantization Errors+: Quantized Models Are Inquisitive Learners—0
Uplink Transmit Power Optimization for Distributed Massive MIMO Systems with 1-Bit ADCs—0
Differentiable Product Quantization for Memory Efficient Camera RelocalizationCode0
MetaAug: Meta-Data Augmentation for Post-Training QuantizationCode0
FedDM: Enhancing Communication Efficiency and Handling Data Heterogeneity in Federated Diffusion Models—0
Power Measurement Enabled Channel Autocorrelation Matrix Estimation for IRS-Assisted Wireless Communication—0
Mixture of Experts with Mixture of Precisions for Tuning Quality of Service—0
Asymptotically Optimal Closed-Form Phase Configuration of 1-bit RISs via Sign Alignment—0
LiNR: Model Based Neural Retrieval on GPUs at LinkedIn—0
Mamba-PTQ: Outlier Channels in Recurrent Large Language Models—0
FETCH: A Memory-Efficient Replay Approach for Continual Learning in Image Classification—0
Toward INT4 Fixed-Point Training via Exploring Quantization Error for Gradients—0
SmartQuant: CXL-based AI Model Store in Support of Runtime Configurable Weight Quantization—0
StoX-Net: Stochastic Processing of Partial Sums for Efficient In-Memory Computing DNN AcceleratorsCode0
MCU-MixQ: A HW/SW Co-optimized Mixed-precision Neural Network Design Framework for MCUs—0
Co-Designing Binarized Transformer and Hardware Accelerator for Efficient End-to-End Edge Deployment—0
LRQ: Optimizing Post-Training Quantization for Large Language Models by Learning Low-Rank Weight-Scaling MatricesCode0
QVD: Post-training Quantization for Video Diffusion Models—0
Rate-Distortion-Cognition Controllable Versatile Neural Image Compression—0
Tiled Bit Networks: Sub-Bit Neural Network Compression Through Reuse of Learnable Binary Vectors—0
NITRO-D: Native Integer-only Training of Deep Convolutional Neural NetworksCode0
Quality Scalable Quantization Methodology for Deep Learning on Edge—0
SEMINAR: Search Enhanced Multi-modal Interest Network and Approximate Retrieval for Lifelong Sequential Recommendation—0
Quantized Prompt for Efficient Generalization of Vision-Language ModelsCode0
A Bag of Tricks for Scaling CPU-based Deep FFMs to more than 300m Predictions per Second—0
LeanQuant: Accurate Large Language Model Quantization with Loss-Error-Aware Grid—0
Semi-supervised 3D Object Detection with PatchTeacher and PillarMixCode0
One-Bit MIMO Detection: From Global Maximum-Likelihood Detector to Amplitude Retrieval Approach—0
Accuracy is Not All You Need—0
Optimization of DNN-based speaker verification model through efficient quantization technique—0
ADMM Based Semi-Structured Pattern Pruning Framework For Transformer—0
Show:102550
← PrevPage 37 of 99Next →
All datasetsImageNetCIFAR-10Wiki-40BAgeDB-30CFP-FPCOCO (Common Objects in Context)IJB-BIJB-CKnowledge-based:LFW

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1FQ-ViT (ViT-L)Top-1 Accuracy (%)85.03—Unverified
2FQ-ViT (ViT-B)Top-1 Accuracy (%)83.31—Unverified
3FQ-ViT (Swin-B)Top-1 Accuracy (%)82.97—Unverified
4FQ-ViT (Swin-S)Top-1 Accuracy (%)82.71—Unverified
5FQ-ViT (DeiT-B)Top-1 Accuracy (%)81.2—Unverified
6FQ-ViT (Swin-T)Top-1 Accuracy (%)80.51—Unverified
7FQ-ViT (DeiT-S)Top-1 Accuracy (%)79.17—Unverified
8Xception W8A8Top-1 Accuracy (%)78.97—Unverified
9ADLIK-MO-ResNet50-W4A4Top-1 Accuracy (%)77.88—Unverified
10ADLIK-MO-ResNet50-W3A4Top-1 Accuracy (%)77.34—Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_3MAP160,327.04—Unverified
2DTQMAP0.79—Unverified
#ModelMetricClaimedVerifiedStatus
1OutEffHop-Bert_basePerplexity6.3—Unverified
2OutEffHop-Bert_basePerplexity6.21—Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy98.13—Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy92.92—Unverified
#ModelMetricClaimedVerifiedStatus
1SSD ResNet50 V1 FPN 640x640MAP34.3—Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-495.13—Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-496.38—Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_5All84,809,664—Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy99.8—Unverified