SOTAVerified

Quantization

Quantization is a promising technique to reduce the computation cost of neural network training, which can replace high-cost floating-point numbers (e.g., float32) with low-cost fixed-point numbers (e.g., int8/int16).

Source: Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers

Papers

Showing 19011925 of 4925 papers

TitleStatusHype
BitNet: Scaling 1-bit Transformers for Large Language ModelsCode2
Robustness and Approximation of Discrete-time Mean-field Games under Discounted Cost Criterion0
RoomDesigner: Encoding Anchor-latents for Style-consistent and Shape-compatible Indoor Scene GenerationCode1
One-Shot Sensitivity-Aware Mixed Sparsity Pruning for Large Language ModelsCode0
LL-VQ-VAE: Learnable Lattice Vector-Quantization For Efficient Representations0
QUIK: Towards End-to-End 4-Bit Inference on Generative Large Language ModelsCode1
Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic EnhancementCode1
LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language ModelsCode2
A Carbon Tracking Model for Federated Learning: Impact of Quantization and Sparsification0
QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language ModelsCode1
Adaptive Quantization for Key Generation in Low-Power Wide-Area Networks0
Cost-Driven Hardware-Software Co-Optimization of Machine Learning Pipelines0
CacheGen: KV Cache Compression and Streaming for Fast Large Language Model ServingCode5
QFT: Quantized Full-parameter Tuning of LLMs with Affordable Resources0
Sparse Fine-tuning for Inference Acceleration of Large Language ModelsCode1
Distillation Improves Visual Place Recognition for Low Quality ImagesCode0
Efficient-VQGAN: Towards High-Resolution Image Generation with Efficient Vision Transformers0
Vector Quantized Multi-modal Guidance for Alzheimer’s Disease Diagnosis Based on Feature ImputationCode0
Dual Grained Quantization: Efficient Fine-Grained Quantization for LLM0
Sub-token ViT Embedding via Stochastic Resonance TransformersCode0
Hadamard Domain Training with Integers for Class Incremental Quantized Learning0
VaSAB: The variable size adaptive information bottleneck for disentanglement on speech and singing voice0
EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion ModelsCode1
Learning A Disentangling Representation For PU Learning0
Robustness-Guided Image Synthesis for Data-Free Quantization0
Show:102550
← PrevPage 77 of 197Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1FQ-ViT (ViT-L)Top-1 Accuracy (%)85.03Unverified
2FQ-ViT (ViT-B)Top-1 Accuracy (%)83.31Unverified
3FQ-ViT (Swin-B)Top-1 Accuracy (%)82.97Unverified
4FQ-ViT (Swin-S)Top-1 Accuracy (%)82.71Unverified
5FQ-ViT (DeiT-B)Top-1 Accuracy (%)81.2Unverified
6FQ-ViT (Swin-T)Top-1 Accuracy (%)80.51Unverified
7FQ-ViT (DeiT-S)Top-1 Accuracy (%)79.17Unverified
8Xception W8A8Top-1 Accuracy (%)78.97Unverified
9ADLIK-MO-ResNet50-W4A4Top-1 Accuracy (%)77.88Unverified
10ADLIK-MO-ResNet50-W3A4Top-1 Accuracy (%)77.34Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_3MAP160,327.04Unverified
2DTQMAP0.79Unverified
#ModelMetricClaimedVerifiedStatus
1OutEffHop-Bert_basePerplexity6.3Unverified
2OutEffHop-Bert_basePerplexity6.21Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy98.13Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy92.92Unverified
#ModelMetricClaimedVerifiedStatus
1SSD ResNet50 V1 FPN 640x640MAP34.3Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-495.13Unverified
#ModelMetricClaimedVerifiedStatus
1TAR @ FAR=1e-496.38Unverified
#ModelMetricClaimedVerifiedStatus
13DCNN_VIVA_5All84,809,664Unverified
#ModelMetricClaimedVerifiedStatus
1Accuracy99.8Unverified