SOTAVerified

parameter-efficient fine-tuning

Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 401–450 of 935 papers

TitleStatusHype
Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models—0
Is your LLM trapped in a Mental Set? Investigative study on how mental sets affect the reasoning capabilities of LLMs—0
iTBLS: A Dataset of Interactive Conversations Over Tabular Information—0
A Fine-tuning Enhanced RAG System with Quantized Influence Measure as AI Judge—0
A Hessian-informed hyperparameter optimization for differential learning rate—0
High-Accuracy ECG Image Interpretation using Parameter-Efficient LoRA Fine-Tuning with Multimodal LLaMA 3.2—0
DESIRE: Dynamic Knowledge Consolidation for Rehearsal-Free Continual Learning—0
HiFi Tuner: High-Fidelity Subject-Driven Fine-Tuning for Diffusion Models—0
HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation—0
KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning—0
AuroRA: Breaking Low-Rank Bottleneck of LoRA with Nonlinear Mapping—0
Know Where You're Going: Meta-Learning for Parameter-Efficient Fine-Tuning—0
HeLM: Highlighted Evidence augmented Language Model for Enhanced Table-to-Text Generation—0
L4Q: Parameter Efficient Quantization-Aware Fine-Tuning on Large Language Models—0
Defending Against Weight-Poisoning Backdoor Attacks for Parameter-Efficient Fine-Tuning—0
HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization—0
LayerNorm: A key component in parameter-efficient fine-tuning—0
BiLoRA: Almost-Orthogonal Parameter Spaces for Continual Learning—0
EEG-Based Mental Imagery Task Adaptation via Ensemble of Weight-Decomposed Low-Rank Adapters—0
HD-PiSSA: High-Rank Distributed Orthogonal Adaptation—0
A Text-Based Knowledge-Embedded Soft Sensing Modeling Approach for General Industrial Process Tasks Based on Large Language Model—0
Efficiency at Scale: Investigating the Performance of Diminutive Language Models in Clinical Tasks—0
LeMo: Enabling LEss Token Involvement for MOre Context Fine-tuning—0
Correcting Negative Bias in Large Language Models through Negative Attention Score Alignment—0
Less is More: Extreme Gradient Boost Rank-1 Adaption for Efficient Finetuning of LLMs—0
MAST-Pro: Dynamic Mixture-of-Experts for Adaptive Segmentation of Pan-Tumors with Knowledge-Driven Prompts—0
Let's Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language Model—0
Activation Control for Efficiently Eliciting Long Chain-of-thought Ability of Language Models—0
Efficient Adaptation of Pre-trained Vision Transformer underpinned by Approximately Orthogonal Fine-Tuning Strategy—0
Lifelong Learning with Task-Specific Adaptation: Addressing the Stability-Plasticity Dilemma—0
Advancing Enterprise Spatio-Temporal Forecasting Applications: Data Mining Meets Instruction Tuning of Language Models For Multi-modal Time Series Analysis in Low-Resource Settings—0
MAP: Revisiting Weight Decomposition for Low-Rank Adaptation—0
Harnessing Generative LLMs for Enhanced Financial Event Entity Extraction Performance—0
LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuning—0
HARIS: Human-Like Attention for Reference Image Segmentation—0
LLMI3D: Empowering LLM with 3D Perception from a Single 2D Image—0
LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning—0
Hallucinations and Truth: A Comprehensive Accuracy Evaluation of RAG, LoRA and DoRA—0
LoFT: Low-Rank Adaptation That Behaves Like Full Fine-Tuning—0
Deconfounded Causality-aware Parameter-Efficient Fine-Tuning for Problem-Solving Improvement of LLMs—0
Mamba State-Space Models Are Lyapunov-Stable Learners—0
LoKO: Low-Rank Kalman Optimizer for Online Fine-Tuning of Large Models—0
Efficient Federated Class-Incremental Learning of Pre-Trained Models via Task-agnostic Low-rank Residual Adaptation—0
Adapters Mixup: Mixing Parameter-Efficient Adapters to Enhance the Adversarial Robustness of Fine-tuned Pre-trained Text Classifiers—0
LoRA as a Flexible Framework for Securing Large Vision Systems—0
LoRACode: LoRA Adapters for Code Embeddings—0
GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning—0
GraphLoRA: Empowering LLMs Fine-Tuning via Graph Collaboration of MoE—0
Decentralized Low-Rank Fine-Tuning of Large Language Models—0
Graph Adapter of EEG Foundation Models for Parameter Efficient Fine Tuning—0
Show:102550
← PrevPage 9 of 19Next →
All datasetsBoolQHellaSwagWinoGrande

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )82.63—Unverified
2LLaMA2-7bAccuracy (% )82.63—Unverified
3LLaMA2-7bAccuracy (% )81.93—Unverified
4LLaMA2-7bAccuracy (% )80.28—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )76.68—Unverified
2LLaMA2-7bAccuracy (% )76.67—Unverified
3LLaMA2-7bAccuracy (% )76.27—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )70.8—Unverified
2LLaMA2-7bAccuracy (% )70.09—Unverified
3LLaMA2-7bAccuracy (% )69.85—Unverified