SOTAVerified

Quantization

Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).

Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers

Papers

Showing 33513400 of 4925 papers

TitleStatusHype
1.58-bit FLUX0
ZOQO: Zero-Order Quantized Optimization0
Deep Learning on Mobile Devices - A Review0
Reconstruction of Privacy-Sensitive Data from Protected Templates0
2-bit Model Compression of Deep Convolutional Neural Network on ASIC Engine for Image Retrieval0
Unsupervised automatic classification of Scanning Electron Microscopy (SEM) images of CD4+ cells with varying extent of HIV virion infection0
DeepCABAC: Context-adaptive binary arithmetic coding for deep neural network compression0
Efficient 8-Bit Quantization of Transformer Neural Machine Language Translation Model0
Structured Binary Neural Networks for Image Recognition0
HAWKEYE: Adversarial Example Detector for Deep Neural Networks0
1-Bit Compressive Sensing for Efficient Federated Learning Over the Air0
1-bit Localization Scheme for Radar using Dithered Quantized Compressed Sensing0
1-bit Quantized On-chip Hybrid Diffraction Neural Network Enabled by Authentic All-optical Fully-connected Architecture0
1st-Order Dynamics on Nonlinear Agents for Resource Allocation over Uniformly-Connected Networks0
Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval0
CDFGNN: a Systematic Design of Cache-based Distributed Full-Batch Graph Neural Network Training with Communication Reduction0
UniMoT: Unified Molecule-Text Language Model with Discrete Token Representation0
Reclaiming Residual Knowledge: A Novel Paradigm to Low-Bit Quantization0
HMDN: Hierarchical Multi-Distribution Network for Click-Through Rate Prediction0
STBLLM: Breaking the 1-Bit Barrier with Structured Binary LLMs0
An approach to optimize inference of the DIART speaker diarization pipeline0
Self-Supervised Learning for Multi-Channel Neural Transducer0
Synaptic Modulation using Interspike Intervals Increases Energy Efficiency of Spiking Neural Networks0
L3iTC at the FinLLM Challenge Task: Quantization for Financial Text Classification & Summarization0
Inference Optimizations for Large Language Models: Effects, Challenges, and Practical Considerations0
DopQ-ViT: Towards Distribution-Friendly and Outlier-Aware Post-Training Quantization for Vision Transformers0
MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations0
A probabilistic framework for dynamic quantization0
Gaussian Weight Sampling for Scalable, Efficient and Stable Pseudo-Quantization Training0
MARRS: Masked Autoregressive Unit-based Reaction Synthesis0
QVGen: Pushing the Limit of Quantized Video Generative Models0
Auditing Black-Box LLM APIs with a Rank-Based Uniformity Test0
Optimizing Learned Image Compression on Scalar and Entropy-Constraint Quantization0
POLARON: Precision-aware On-device Learning and Adaptive Runtime-cONfigurable AI acceleration0
Implementing Keyword Spotting on the MCUX947 Microcontroller with Integrated NPU0
Discrete Audio Tokens: More Than a Survey!0
Starting Positions Matter: A Study on Better Weight Initialization for Neural Network Quantization0
2-bit Conformer quantization for automatic speech recognition0
2-Bit Random Projections, NonLinear Estimators, and Approximate Near Neighbor Search0
2-in-1 Accelerator: Enabling Random Precision Switch for Winning Both Adversarial Robustness and Efficiency0
3D Gaussian Splatting Data Compression with Mixture of Priors0
3DMolNet: A Generative Network for Molecular Structures0
3D Pathfinding and Collision Avoidance Using Uneven Search-space Quantization and Visual Cone Search0
3DQ: Compact Quantized Neural Networks for Volumetric Whole Brain Segmentation0
3D representation in 512-Byte:Variational tokenizer is the key for autoregressive 3D generation0
3D Surface Detail Enhancement From a Single Normal Map0
3LC: Lightweight and Effective Traffic Compression for Distributed Machine Learning0
3U-EdgeAI: Ultra-Low Memory Training, Ultra-Low BitwidthQuantization, and Ultra-Low Latency Acceleration0
4-bit Quantization of LSTM-based Speech Recognition Models0
4DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Video0
Show:102550
← PrevPage 68 of 99Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1FQ-ViT (ViT-L)Top-1 Accuracy (%)85.03Unverified
2FQ-ViT (ViT-B)Top-1 Accuracy (%)83.31Unverified
3FQ-ViT (Swin-B)Top-1 Accuracy (%)82.97Unverified
4FQ-ViT (Swin-S)Top-1 Accuracy (%)82.71Unverified
5FQ-ViT (DeiT-B)Top-1 Accuracy (%)81.2Unverified
6FQ-ViT (Swin-T)Top-1 Accuracy (%)80.51Unverified
7FQ-ViT (DeiT-S)Top-1 Accuracy (%)79.17Unverified
8Xception W8A8Top-1 Accuracy (%)78.97Unverified
9ADLIK-MO-ResNet50-W4A4Top-1 Accuracy (%)77.88Unverified
10ADLIK-MO-ResNet50-W3A4Top-1 Accuracy (%)77.34Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_3MAP160,327.04Unverified
2DTQMAP0.79Unverified
#ModelMetricClaimedVerifiedStatus
1OutEffHop-Bert_basePerplexity6.3Unverified
2OutEffHop-Bert_basePerplexity6.21Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy98.13Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy92.92Unverified
#ModelMetricClaimedVerifiedStatus
1SSD ResNet50 V1 FPN 640x640MAP34.3Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-495.13Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-496.38Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_5All84,809,664Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy99.8Unverified