SOTAVerified

parameter-efficient fine-tuning

Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.

Papers

Showing 651700 of 935 papers

TitleStatusHype
Federated Adversarial Learning for Robust Autonomous Landing Runway Detection0
Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resources0
Federated Low-Rank Adaptation with Differential Privacy over Wireless Networks0
FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning0
FedMCP: Parameter-Efficient Federated Learning with Model-Contrastive Personalization0
FedP^2EFT: Federated Learning to Personalize Parameter Efficient Fine-Tuning for Multilingual LLMs0
FedPEAT: Convergence of Federated Learning, Parameter-Efficient Fine Tuning, and Emulator Assisted Tuning for Artificial Intelligence Foundation Models with Mobile Edge Computing0
FedPIA -- Permuting and Integrating Adapters leveraging Wasserstein Barycenters for Finetuning Foundation Models in Multi-Modal Federated Learning0
FedSCA: Federated Tuning with Similarity-guided Collaborative Aggregation for Heterogeneous Medical Image Segmentation0
FedVLMBench: Benchmarking Federated Fine-Tuning of Vision-Language Models0
FeTT: Continual Class Incremental Learning via Feature Transformation Tuning0
PETA: Parameter-Efficient Trojan Attacks0
Few-Shot Adversarial Low-Rank Fine-Tuning of Vision-Language Models0
FineCLIPER: Multi-modal Fine-grained CLIP for Dynamic Facial Expression Recognition with AdaptERs0
FINE: Factorizing Knowledge for Initialization of Variable-sized Diffusion Models0
Fine-tuning vision foundation model for crack segmentation in civil infrastructures0
Fine Tuning without Catastrophic Forgetting via Selective Low Rank Adaptation0
FinLlama: Financial Sentiment Classification for Algorithmic Trading Applications0
FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis0
FISH-Tuning: Enhancing PEFT Methods with Fisher Information0
Flat-LoRA: Low-Rank Adaption over a Flat Loss Landscape0
FLoRIST: Singular Value Thresholding for Efficient and Accurate Federated Fine-Tuning of Large Language Models0
From Text to Emoji: How PEFT-Driven Personality Manipulation Unleashes the Emoji Potential in LLMs0
From Words to Worth: Newborn Article Impact Prediction with LLM0
Functional-level Uncertainty Quantification for Calibrated Fine-tuning on LLMs0
G-Adapter: Towards Structure-Aware Parameter-Efficient Transfer Learning for Graph Transformer Networks0
Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devices0
Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning0
Generalizability of Mixture of Domain-Specific Adapters from the Lens of Signed Weight Directions and its Application to Effective Model Pruning0
Generalized Tensor-based Parameter-Efficient Fine-Tuning via Lie Group Transformations0
Generative Modeling of Individual Behavior at Scale0
GeoLoRA: Geometric integration for parameter efficient fine-tuning0
Get Large Language Models Ready to Speak: A Late-fusion Approach for Speech Generation0
GP-MoLFormer: A Foundation Model For Molecular Generation0
GPT vs RETRO: Exploring the Intersection of Retrieval and Parameter-Efficient Fine-Tuning0
Graph Adapter of EEG Foundation Models for Parameter Efficient Fine Tuning0
GraphLoRA: Empowering LLMs Fine-Tuning via Graph Collaboration of MoE0
GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning0
Hallucinations and Truth: A Comprehensive Accuracy Evaluation of RAG, LoRA and DoRA0
HARIS: Human-Like Attention for Reference Image Segmentation0
Harnessing Generative LLMs for Enhanced Financial Event Entity Extraction Performance0
HD-PiSSA: High-Rank Distributed Orthogonal Adaptation0
HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization0
HeLM: Highlighted Evidence augmented Language Model for Enhanced Table-to-Text Generation0
HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation0
HiFi Tuner: High-Fidelity Subject-Driven Fine-Tuning for Diffusion Models0
High-Accuracy ECG Image Interpretation using Parameter-Efficient LoRA Fine-Tuning with Multimodal LLaMA 3.20
HINT: Hypernetwork Instruction Tuning for Efficient Zero- & Few-Shot Generalisation0
HM3: Heterogeneous Multi-Class Model Merging0
House of Cards: Massive Weights in LLMs0
Show:102550
← PrevPage 14 of 19Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )82.63Unverified
2LLaMA2-7bAccuracy (% )82.63Unverified
3LLaMA2-7bAccuracy (% )81.93Unverified
4LLaMA2-7bAccuracy (% )80.28Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )76.68Unverified
2LLaMA2-7bAccuracy (% )76.67Unverified
3LLaMA2-7bAccuracy (% )76.27Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )70.8Unverified
2LLaMA2-7bAccuracy (% )70.09Unverified
3LLaMA2-7bAccuracy (% )69.85Unverified