SOTAVerified

Quantization

Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).

Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 801–850 of 4925 papers

TitleStatusHype
Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense EmbeddingsCode1
Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and DistillationCode1
Qimera: Data-free Quantization with Synthetic Boundary Supporting SamplesCode1
Distributed Learning Systems with First-order MethodsCode1
QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language ModelsCode1
Mixed Precision DNNs: All you need is a good parametrizationCode1
Disentanglement via Latent QuantizationCode1
Distribution-Flexible Subset Quantization for Post-Quantizing Super-Resolution NetworksCode1
QT-DoG: Quantization-aware Training for Domain GeneralizationCode1
QTIP: Quantization with Trellises and Incoherence ProcessingCode1
DGQ: Distribution-Aware Group Quantization for Text-to-Image Diffusion ModelsCode1
CNN-based first quantization estimation of double compressed JPEG imagesCode1
QuantCache: Adaptive Importance-Guided Quantization with Hierarchical Latent and Layer Caching for Video GenerationCode1
QuantFace: Towards Lightweight Face Recognition by Synthetic Data Low-bit QuantizationCode1
Unbiased Single-scale and Multi-scale Quantizers for Distributed OptimizationCode1
DFRot: Achieving Outlier-Free and Massive Activation-Free for Rotated LLMs with Refined RotationCode1
Differentiable JPEG: The Devil is in the DetailsCode1
CoCoFL: Communication- and Computation-Aware Federated Learning via Partial NN Freezing and QuantizationCode1
APQ: Joint Search for Network Architecture, Pruning and Quantization PolicyCode1
Quantized Gromov-WassersteinCode1
Device-Robust Acoustic Scene Classification Based on Two-Stage Categorization and Data AugmentationCode1
Differentiable Model Compression via Pseudo Quantization NoiseCode1
DiTAS: Quantizing Diffusion Transformers via Enhanced Activation SmoothingCode1
EasyQuant: Post-training Quantization via Scale OptimizationCode1
Deep PeNSieve: A deep learning framework based on the posit number systemCode1
Deep Learning-Enabled One-Bit DoA EstimationCode1
Deep Transferring QuantizationCode1
Deep Geometry Post-Processing for Decompressed Point CloudsCode1
Dataset Quantization with Active Learning based Adaptive SamplingCode1
Data-Free Network Quantization With Adversarial Knowledge DistillationCode1
Data-Free Quantization Through Weight Equalization and Bias CorrectionCode1
Conditional Coding and Variable Bitrate for Practical Learned Video CodingCode1
Rate-Adaptive Quantization: A Multi-Rate Codebook Adaptation for Vector Quantization-based Generative ModelsCode1
RawHash2: Mapping Raw Nanopore Signals Using Hash-Based Seeding and Adaptive QuantizationCode1
Representing Domain-Mixing Optical Degradation for Real-World Computational Aberration Correction via Vector QuantizationCode1
DeCoAR 2.0: Deep Contextualized Acoustic Representations with Vector QuantizationCode1
AQD: Towards Accurate Fully-Quantized Object DetectionCode1
Reconciling Security and Communication Efficiency in Federated LearningCode1
DenseShift: Towards Accurate and Efficient Low-Bit Power-of-Two QuantizationCode1
Going Beyond Classification Accuracy Metrics in Model CompressionCode1
CycleVAR: Repurposing Autoregressive Model for Unsupervised One-Step Image TranslationCode1
RepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision TransformersCode1
Resolution Switchable Networks for Runtime Efficient Image RecognitionCode1
Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference PipelineCode1
Communication-Efficient Adaptive Federated LearningCode1
D^2-DPM: Dual Denoising for Quantized Diffusion Probabilistic ModelsCode1
COMQ: A Backpropagation-Free Algorithm for Post-Training QuantizationCode1
CondiQuant: Condition Number Based Low-Bit Quantization for Image Super-ResolutionCode1
RGB-Event Fusion with Self-Attention for Collision PredictionCode1
CPLLM: Clinical Prediction with Large Language ModelsCode1
Show:102550
← PrevPage 17 of 99Next →
All datasetsImageNetCIFAR-10Wiki-40BAgeDB-30CFP-FPCOCO (Common Objects in Context)IJB-BIJB-CKnowledge-based:LFW

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1FQ-ViT (ViT-L)Top-1 Accuracy (%)85.03—Unverified
2FQ-ViT (ViT-B)Top-1 Accuracy (%)83.31—Unverified
3FQ-ViT (Swin-B)Top-1 Accuracy (%)82.97—Unverified
4FQ-ViT (Swin-S)Top-1 Accuracy (%)82.71—Unverified
5FQ-ViT (DeiT-B)Top-1 Accuracy (%)81.2—Unverified
6FQ-ViT (Swin-T)Top-1 Accuracy (%)80.51—Unverified
7FQ-ViT (DeiT-S)Top-1 Accuracy (%)79.17—Unverified
8Xception W8A8Top-1 Accuracy (%)78.97—Unverified
9ADLIK-MO-ResNet50-W4A4Top-1 Accuracy (%)77.88—Unverified
10ADLIK-MO-ResNet50-W3A4Top-1 Accuracy (%)77.34—Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_3MAP160,327.04—Unverified
2DTQMAP0.79—Unverified
#ModelMetricClaimedVerifiedStatus
1OutEffHop-Bert_basePerplexity6.3—Unverified
2OutEffHop-Bert_basePerplexity6.21—Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy98.13—Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy92.92—Unverified
#ModelMetricClaimedVerifiedStatus
1SSD ResNet50 V1 FPN 640x640MAP34.3—Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-495.13—Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-496.38—Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_5All84,809,664—Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy99.8—Unverified