SOTAVerified

parameter-efficient fine-tuning

Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 501–550 of 935 papers

TitleStatusHype
Deep Content Understanding Toward Entity and Aspect Target Sentiment Analysis on Foundation ModelsCode0
Investigating Decoder-only Large Language Models for Speech-to-text Translation—0
Soft Language Prompts for Language TransferCode0
Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language ModelsCode4
CatMemo at the FinLLM Challenge Task: Fine-Tuning Large Language Models using Data Fusion in Financial Applications—0
FineCLIPER: Multi-modal Fine-grained CLIP for Dynamic Facial Expression Recognition with AdaptERs—0
Adapting Multilingual LLMs to Low-Resource Languages with Knowledge Graphs via AdaptersCode0
HyperLoader: Integrating Hypernetwork-Based LoRA and Adapter Layers into Multi-Task Transformers for Sequence Labelling—0
SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models—0
FairMedFM: Fairness Benchmarking for Medical Imaging Foundation ModelsCode2
Increasing Model Capacity for Free: A Simple Strategy for Parameter Efficient Fine-tuningCode1
Embedded Prompt Tuning: Towards Enhanced Calibration of Pretrained Models for Medical ImagesCode1
Structured Unrestricted-Rank Matrices for Parameter Efficient Fine-tuningCode0
Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence SegmentationCode7
Towards Scalable Exact Machine Unlearning Using Parameter-Efficient Fine-Tuning—0
Federated Adversarial Learning for Robust Autonomous Landing Runway Detection—0
MU-Bench: A Multitask Multimodal Benchmark for Machine UnlearningCode0
Unlocking the Global Synergies in Low-Rank Adapters—0
Towards Infinite-Long Prefix in TransformerCode0
Bayesian-LoRA: LoRA based Parameter Efficient Fine-Tuning using Optimal Quantization levels and Rank Values trough Differentiable Bayesian Gates—0
Fighting Randomness with Randomness: Mitigating Optimisation Instability of Fine-Tuning using Delayed Ensemble and Noisy InterpolationCode0
RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuningCode0
ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts—0
ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank AdaptationCode0
Promoting Data and Model Privacy in Federated Learning through Quantized LoRA—0
Personalized Pieces: Efficient Personalized Large Language Models through Collaborative EffortsCode1
Parameter-Efficient Active Learning for Foundational models—0
PC-LoRA: Low-Rank Adaptation for Progressive Model Compression with Knowledge Distillation—0
Updating CLIP to Prefer Descriptions Over CaptionsCode0
A Survey of Recent Backdoor Attacks and Defenses in Large Language Models—0
A Parameter-efficient Language Extension Framework for Multilingual ASR—0
Low-Rank Quantization-Aware Training for LLMsCode2
An Improved Empirical Fisher Approximation for Natural Gradient Descent—0
Efficient Differentially Private Fine-Tuning of Diffusion Models—0
MEFT: Memory-Efficient Fine-Tuning through Sparse AdapterCode1
An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language ModelsCode1
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuningCode2
Time Sensitive Knowledge Editing through Efficient Finetuning—0
Hypernetworks for Personalizing ASR to Atypical Speech—0
Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early PruningCode1
VHDL-Eval: A Framework for Evaluating Large Language Models in VHDL Code Generation—0
Choice of PEFT Technique in Continual Learning: Prompt Tuning is Not All You Need—0
Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Vision—0
Low-Rank Adaption on Transformer-based Oriented Object Detector for Satellite Onboard Processing of Remote Sensing ImagesCode0
SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information—0
LoFiT: Localized Fine-tuning on LLM RepresentationsCode1
Differentially Private Fine-Tuning of Diffusion Models—0
Mamba State-Space Models Are Lyapunov-Stable Learners—0
Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion ModelsCode0
SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation—0
Show:102550
← PrevPage 11 of 19Next →
All datasetsBoolQHellaSwagWinoGrande

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )82.63—Unverified
2LLaMA2-7bAccuracy (% )82.63—Unverified
3LLaMA2-7bAccuracy (% )81.93—Unverified
4LLaMA2-7bAccuracy (% )80.28—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )76.68—Unverified
2LLaMA2-7bAccuracy (% )76.67—Unverified
3LLaMA2-7bAccuracy (% )76.27—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )70.8—Unverified
2LLaMA2-7bAccuracy (% )70.09—Unverified
3LLaMA2-7bAccuracy (% )69.85—Unverified