SOTAVerified

parameter-efficient fine-tuning

Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.

Papers

Showing 551575 of 935 papers

TitleStatusHype
LoRA as a Flexible Framework for Securing Large Vision Systems0
LoRACode: LoRA Adapters for Code Embeddings0
LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization0
LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation0
LoRA Dropout as a Sparsity Regularizer for Overfitting Control0
LoRA ensembles for large language model fine-tuning0
LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement0
LoRAGuard: An Effective Black-box Watermarking Approach for LoRAs0
LoRA-Mini : Adaptation Matrices Decomposition and Selective Training0
LoRA-X: Bridging Foundation Models with Training-Free Cross-Model Adaptation0
LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression0
LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM0
LoRTA: Low Rank Tensor Adaptation of Large Language Models0
LoTR: Low Tensor Rank Weight Adaptation0
LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits0
Low-Rank Adaptation of Neural Fields0
Low-Rank Adapters Meet Neural Architecture Search for LLM Compression0
Low-rank Attention Side-Tuning for Parameter-Efficient Fine-Tuning0
LPT++: Efficient Training on Mixture of Long-tailed Experts0
Parameter-Efficient Continual Fine-Tuning: A Survey0
Parameter Efficient Continual Learning with Dynamic Low-Rank Adaptation0
Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications0
Parameter-Efficient Fine-Tuning Design Spaces0
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective0
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey0
Show:102550
← PrevPage 23 of 38Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )82.63Unverified
2LLaMA2-7bAccuracy (% )82.63Unverified
3LLaMA2-7bAccuracy (% )81.93Unverified
4LLaMA2-7bAccuracy (% )80.28Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )76.68Unverified
2LLaMA2-7bAccuracy (% )76.67Unverified
3LLaMA2-7bAccuracy (% )76.27Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )70.8Unverified
2LLaMA2-7bAccuracy (% )70.09Unverified
3LLaMA2-7bAccuracy (% )69.85Unverified