SOTAVerified

Quantization

Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).

Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers

Papers

Showing 12011250 of 4925 papers

TitleStatusHype
PRISM: Privacy-Preserving Improved Stochastic Masking for Federated Generative ModelsCode0
Lightweight Multimodal Artificial Intelligence Framework for Maritime Multi-Scene Recognition0
Synchronized Video-to-Audio Generation via Mel Quantization-Continuum Decomposition0
Breaking the Limits of Quantization-Aware Defenses: QADT-R for Robustness Against Patch-Based Adversarial Attacks in QNNs0
VocalEyes: Enhancing Environmental Perception for the Visually Impaired through Vision-Language Models and Distance-Aware Object Detection0
Non-vacuous Generalization Bounds for Deep Neural Networks without any modification to the trained models0
Task Vector Quantization for Memory-Efficient Model MergingCode0
Post-Training Quantization for Diffusion Transformer via Hierarchical Timestep Grouping0
Seeing Delta Parameters as JPEG Images: Data-Free Delta Compression with Discrete Cosine Transform0
TR-DQ: Time-Rotation Diffusion Quantization0
Does Acceleration Cause Hidden Instability in Vision Language Models? Uncovering Instance-Level Divergence Through a Large-Scale Empirical Study0
SAQ-SAM: Semantically-Aligned Quantization for Segment Anything Model0
PathVQ: Reforming Computational Pathology Foundation Model for Whole Slide Image Analysis via Vector Quantization0
Towards Superior Quantization Accuracy: A Layer-sensitive Approach0
Discrete Contrastive Learning for Diffusion Policies in Autonomous Driving0
Frequency Autoregressive Image Generation with Continuous Tokens0
CASP: Compression of Large Multimodal Models Based on Attention SparsityCode0
End-to-End Human Pose Reconstruction from Wearable Sensors for 6G Extended Reality SystemsCode0
Universality of Layer-Level Entropy-Weighted Quantization Beyond Model Architecture and Size0
VQEL: Enabling Self-Developed Symbolic Language in Agents through Vector Quantization in Emergent Language Games0
LVLM-Compress-Bench: Benchmarking the Broader Impact of Large Vision-Language Model CompressionCode0
AHCPTQ: Accurate and Hardware-Compatible Post-Training Quantization for Segment Anything Model0
English K_Quantization of LLMs Does Not Disproportionately Diminish Multilingual Performance0
Lightweight Embedded FPGA Deployment of Learned Image Compression with Knowledge Distillation and Hybrid Quantization0
On the Relation Between Speech Quality and Quantized Latent Representations of Neural Codecs0
Fast Jet Tagging with MLP-Mixers on FPGAs0
Q&C: When Quantization Meets Cache in Efficient Image GenerationCode0
Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense Representations0
BdSLW401: Transformer-Based Word-Level Bangla Sign Language Recognition Using Relative Quantization Encoding (RQE)0
Regularization-based Framework for Quantization-, Fault- and Variability-Aware Training0
KurTail : Kurtosis-based LLM Quantization0
Cauchy-Schwarz RegularizersCode0
Towards Improved Text-Aligned Codebook Learning: Multi-Hierarchical Codebook-Text Alignment with Long Text0
DILEMMA: Joint LLM Quantization and Distributed LLM Inference Over Edge Computing Systems0
DeRS: Towards Extremely Efficient Upcycled Mixture-of-Experts Models0
Patient-Level Anatomy Meets Scanning-Level Physics: Personalized Federated Low-Dose CT Denoising Empowered by Large Language ModelCode0
MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations0
Strong Solutions and Quantization-Based Numerical Schemes for a Class of Non-Markovian Volatility Models0
Transformer-Based Nonlinear Transform Coding for Multi-Rate CSI Compression in MIMO-OFDM Systems0
HALO: Hardware-aware quantization with low critical-path-delay weights for LLM acceleration0
Beyond the Tip of Efficiency: Uncovering the Submerged Threats of Jailbreak Attacks in Small Language Models0
Speculative Decoding and Beyond: An In-Depth Review of Techniques0
On the Privacy-Preserving Properties of Spiking Neural Networks with Unique Surrogate Gradients and Quantization Levels0
Compressing Language Models for Specialized Domains0
Memory-Free and Parallel Computation for Quantized Spiking Neural Networks0
Task-Driven Semantic Quantization and Imitation Learning for Goal-Oriented Communications0
Unbiased and Sign Compression in Distributed Learning: Comparing Noise Resilience via SDEs0
Compression Scaling Laws:Unifying Sparsity and Quantization0
Energy-Efficient Transformer Inference: Optimization Strategies for Time Series Classification0
Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registration0
Show:102550
← PrevPage 25 of 99Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1FQ-ViT (ViT-L)Top-1 Accuracy (%)85.03Unverified
2FQ-ViT (ViT-B)Top-1 Accuracy (%)83.31Unverified
3FQ-ViT (Swin-B)Top-1 Accuracy (%)82.97Unverified
4FQ-ViT (Swin-S)Top-1 Accuracy (%)82.71Unverified
5FQ-ViT (DeiT-B)Top-1 Accuracy (%)81.2Unverified
6FQ-ViT (Swin-T)Top-1 Accuracy (%)80.51Unverified
7FQ-ViT (DeiT-S)Top-1 Accuracy (%)79.17Unverified
8Xception W8A8Top-1 Accuracy (%)78.97Unverified
9ADLIK-MO-ResNet50-W4A4Top-1 Accuracy (%)77.88Unverified
10ADLIK-MO-ResNet50-W3A4Top-1 Accuracy (%)77.34Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_3MAP160,327.04Unverified
2DTQMAP0.79Unverified
#ModelMetricClaimedVerifiedStatus
1OutEffHop-Bert_basePerplexity6.3Unverified
2OutEffHop-Bert_basePerplexity6.21Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy98.13Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy92.92Unverified
#ModelMetricClaimedVerifiedStatus
1SSD ResNet50 V1 FPN 640x640MAP34.3Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-495.13Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-496.38Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_5All84,809,664Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy99.8Unverified