SOTAVerified

parameter-efficient fine-tuning

Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 901–935 of 935 papers

TitleStatusHype
RocketPPA: Code-Level Power, Performance, and Area Prediction via LLM and Mixture of Experts—0
RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization—0
SPD-CFL: Stepwise Parameter Dropout for Efficient Continual Federated Learning—0
SaLoRA: Safety-Alignment Preserved Low-Rank Adaptation—0
SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation—0
SAM-PARSER: Fine-tuning SAM Efficiently by Parameter Space Reconstruction—0
Scaled Prompt-Tuning for Few-Shot Natural Language Generation—0
Scaling Laws for Forgetting When Fine-Tuning Large Language Models—0
Scaling Up Summarization: Leveraging Large Language Models for Long Text Extractive Summarization—0
SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA—0
Sculpting [CLS] Features for Pre-Trained Model-Based Class-Incremental Learning—0
SECURA: Sigmoid-Enhanced CUR Decomposition with Uninterrupted Retention and Low-Rank Adaptation in Large Language Models—0
Selective Fine-tuning on LLM-labeled Data May Reduce Reliance on Human Annotation: A Case Study Using Schedule-of-Event Table Detection—0
Self-Corrected Multimodal Large Language Model for End-to-End Robot Manipulation—0
Semantic are Beacons: A Semantic Perspective for Unveiling Parameter-Efficient Fine-Tuning in Knowledge Learning—0
Sensitivity-Aware Efficient Fine-Tuning via Compact Dynamic-Rank Adaptation—0
Sequential Compression Layers for Efficient Federated Learning in Foundational Models—0
Sequential LLM Framework for Fashion Recommendation—0
Sharp Generalization Bounds for Foundation Models with Asymmetric Randomized Low-Rank Adapters—0
Shears: Unstructured Sparsity with Neural Low-rank Adapter Search—0
SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning—0
Singular Value Fine-tuning for Few-Shot Class-Incremental Learning—0
Skeleton: A New Framework for Accelerating Language Models via Task Neuron Localized Prompt Tuning—0
SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixture—0
SLoRA: Federated Parameter Efficient Fine-Tuning of Language Models—0
SOLIDO: A Robust Watermarking Method for Speech Synthesis via Low-Rank Adaptation—0
SoMA: Singular Value Decomposed Minor Components Adaptation for Domain Generalizable Representation Learning—0
SPAFIT: Stratified Progressive Adaptation Fine-tuning for Pre-trained Large Language Models—0
Sparsely Shared LoRA on Whisper for Child Speech Recognition—0
Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning—0
Sparsity- and Hybridity-Inspired Visual Parameter-Efficient Fine-Tuning for Medical Diagnosis—0
Speech Recognition for Automatically Assessing Afrikaans and isiXhosa Preschool Oral Narratives—0
SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models—0
SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning—0
SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models—0
Show:102550
← PrevPage 19 of 19Next →
All datasetsBoolQHellaSwagWinoGrande

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )82.63—Unverified
2LLaMA2-7bAccuracy (% )82.63—Unverified
3LLaMA2-7bAccuracy (% )81.93—Unverified
4LLaMA2-7bAccuracy (% )80.28—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )76.68—Unverified
2LLaMA2-7bAccuracy (% )76.67—Unverified
3LLaMA2-7bAccuracy (% )76.27—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )70.8—Unverified
2LLaMA2-7bAccuracy (% )70.09—Unverified
3LLaMA2-7bAccuracy (% )69.85—Unverified