parameter-efficient fine-tuning

Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 26–50 of 935 papers

Title	Date	Tasks	Status	Hype	Score
MTLoRA: Low-Rank Adaptation Approach for Efficient Multi-Task Learning	Jan 1, 2024	Multi-Task Learningparameter-efficient fine-tuning	CodeCode Available	2	5
MiniGPT-3D: Efficiently Aligning 3D Point Clouds with Large Language Models using 2D Priors	May 2, 2024	3D Object Captioning3D Object Classification	CodeCode Available	2	5
Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning	May 9, 2024	parameter-efficient fine-tuningVisual Prompting	CodeCode Available	2	5
Low-Rank Quantization-Aware Training for LLMs	Jun 10, 2024	GPUparameter-efficient fine-tuning	CodeCode Available	2	5
One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning	Jun 13, 2023	AllDomain Generalization	CodeCode Available	2	5
LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters	May 27, 2024	BenchmarkingGSM8K	CodeCode Available	2	5
LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation	Apr 10, 2025	Code GenerationContinual Learning	CodeCode Available	2	5
Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignment	Feb 24, 2025	image-classificationImage Classification	CodeCode Available	2	5
MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning	Mar 29, 2024	Multi-Task Learningparameter-efficient fine-tuning	CodeCode Available	2	5
A Survey on Federated Fine-tuning of Large Language Models	Mar 15, 2025	Federated Learningparameter-efficient fine-tuning	CodeCode Available	2	5
LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restoration	Oct 20, 2024	AllComputational Efficiency	CodeCode Available	2	5
Learning to Route Among Specialized Experts for Zero-Shot Generalization	Feb 8, 2024	parameter-efficient fine-tuningZero-shot Generalization	CodeCode Available	2	5
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning	Jun 7, 2024	Instruction FollowingMath	CodeCode Available	2	5
Comparing Retrieval-Augmentation and Parameter-Efficient Fine-Tuning for Privacy-Preserving Personalization of Large Language Models	Sep 14, 2024	parameter-efficient fine-tuningPrivacy Preserving	CodeCode Available	2	5
LoRA: Low-Rank Adaptation of Large Language Models	Jun 17, 2021	GPULanguage Modelling	CodeCode Available	2	5
Any2Point: Empowering Any-modality Large Models for Efficient 3D Understanding	Apr 11, 2024	3D geometryparameter-efficient fine-tuning	CodeCode Available	2	5
InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning	Mar 30, 2024	Continual Learningparameter-efficient fine-tuning	CodeCode Available	2	5
FATE-LLM: A Industrial Grade Federated Learning Framework for Large Language Models	Oct 16, 2023	Federated Learningparameter-efficient fine-tuning	CodeCode Available	2	5
mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs	Dec 5, 2023	GPULarge Language Model	CodeCode Available	2	5
An Embarrassingly Simple Approach for LLM with Strong ASR Capacity	Feb 13, 2024	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	CodeCode Available	2	5
CoLLiE: Collaborative Training of Large Language Models in an Efficient Way	Dec 1, 2023	GPUparameter-efficient fine-tuning	CodeCode Available	2	5
FairMedFM: Fairness Benchmarking for Medical Imaging Foundation Models	Jul 1, 2024	BenchmarkingFairness	CodeCode Available	2	5
Full Parameter Fine-tuning for Large Language Models with Limited Resources	Jun 16, 2023	GPUparameter-efficient fine-tuning	CodeCode Available	2	5
Earth-Adapter: Bridge the Geospatial Domain Gaps with Mixture of Frequency Adaptation	Apr 8, 2025	Domain AdaptationDomain Generalization	CodeCode Available	2	5
Efficient Remote Sensing with Harmonized Transfer Learning and Modality Alignment	Apr 28, 2024	Cross-Modal RetrievalImage Retrieval	CodeCode Available	2	5

Show:10 25 50

← PrevPage 2 of 38Next →

All datasets BoolQ HellaSwag WinoGrande

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	LLaMA2-7b	Accuracy (% )	82.63	—	Unverified
2	LLaMA2-7b	Accuracy (% )	82.63	—	Unverified
3	LLaMA2-7b	Accuracy (% )	81.93	—	Unverified
4	LLaMA2-7b	Accuracy (% )	80.28	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA2-7b	Accuracy (% )	76.68	—	Unverified
2	LLaMA2-7b	Accuracy (% )	76.67	—	Unverified
3	LLaMA2-7b	Accuracy (% )	76.27	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaMA2-7b	Accuracy (% )	70.8	—	Unverified
2	LLaMA2-7b	Accuracy (% )	70.09	—	Unverified
3	LLaMA2-7b	Accuracy (% )	69.85	—	Unverified