SOTAVerified

Quantization

Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).

Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers

Papers

Showing 876900 of 4925 papers

TitleStatusHype
Quamba: A Post-Training Quantization Recipe for Selective State Space ModelsCode2
Optimal Quantization for Matrix MultiplicationCode0
Progressive Mixed-Precision Decoding for Efficient LLM Inference0
DPLM-2: A Multimodal Diffusion Protein Language ModelCode3
Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMsCode1
Learning Graph Quantized TokenizersCode1
A Unified View of Delta Parameter Editing in Post-Trained Large-Scale Models0
ERVQ: Enhanced Residual Vector Quantization with Intra-and-Inter-Codebook Optimization for Neural Audio Codecs0
Channel-Wise Mixed-Precision Quantization for Large Language Models0
COMET: Towards Partical W4A4KV4 LLMs Serving0
DAQ: Density-Aware Post-Training Weight-Only Quantization For LLMsCode0
FairGLVQ: Fairness in Partition-Based ClassificationCode0
Scaling Laws for Post Training Quantized Large Language Models0
Efficiera Residual Networks: Hardware-Friendly Fully Binary Weight with 2-bit Activation Model Achieves Practical ImageNet AccuracyCode0
Error Diffusion: Post Training Quantization with Block-Scaled Number Formats for Neural NetworksCode1
Latent Action Pretraining from VideosCode3
QSpec: Speculative Decoding with Complementary Quantization Schemes0
Real-Time Stress Detection via Photoplethysmogram Signals: Implementation of a Combined Continuous Wavelet Transform and Convolutional Neural Network on Resource-Constrained Microcontrollers0
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsCode4
SLaNC: Static LayerNorm Calibration0
Gaussian Mixture Vector Quantization with Aggregated Categorical Posterior0
When Attention Sink Emerges in Language Models: An Empirical ViewCode2
Gradient-Free Neural Network Training on the Edge0
GALA: Geometry-Aware Local Adaptive Grids for Detailed 3D Generation0
FlatQuant: Flatness Matters for LLM QuantizationCode3
Show:102550
← PrevPage 36 of 197Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1FQ-ViT (ViT-L)Top-1 Accuracy (%)85.03Unverified
2FQ-ViT (ViT-B)Top-1 Accuracy (%)83.31Unverified
3FQ-ViT (Swin-B)Top-1 Accuracy (%)82.97Unverified
4FQ-ViT (Swin-S)Top-1 Accuracy (%)82.71Unverified
5FQ-ViT (DeiT-B)Top-1 Accuracy (%)81.2Unverified
6FQ-ViT (Swin-T)Top-1 Accuracy (%)80.51Unverified
7FQ-ViT (DeiT-S)Top-1 Accuracy (%)79.17Unverified
8Xception W8A8Top-1 Accuracy (%)78.97Unverified
9ADLIK-MO-ResNet50-W4A4Top-1 Accuracy (%)77.88Unverified
10ADLIK-MO-ResNet50-W3A4Top-1 Accuracy (%)77.34Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_3MAP160,327.04Unverified
2DTQMAP0.79Unverified
#ModelMetricClaimedVerifiedStatus
1OutEffHop-Bert_basePerplexity6.3Unverified
2OutEffHop-Bert_basePerplexity6.21Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy98.13Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy92.92Unverified
#ModelMetricClaimedVerifiedStatus
1SSD ResNet50 V1 FPN 640x640MAP34.3Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-495.13Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-496.38Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_5All84,809,664Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy99.8Unverified