SOTAVerified

parameter-efficient fine-tuning

Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 701–750 of 935 papers

TitleStatusHype
Low-Rank Adaption on Transformer-based Oriented Object Detector for Satellite Onboard Processing of Remote Sensing ImagesCode0
Differentially Private Fine-Tuning of Diffusion Models—0
SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information—0
Mamba State-Space Models Are Lyapunov-Stable Learners—0
Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion ModelsCode0
SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation—0
Domain-Inspired Sharpness-Aware Minimization Under Domain ShiftsCode0
MemControl: Mitigating Memorization in Diffusion Models via Automated Parameter SelectionCode0
Parameter-efficient Fine-tuning in Hyperspherical Space for Open-vocabulary Semantic Segmentation—0
RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter—0
IAPT: Instruction-Aware Prompt Tuning for Large Language Models—0
Semantic are Beacons: A Semantic Perspective for Unveiling Parameter-Efficient Fine-Tuning in Knowledge Learning—0
Sparsity- and Hybridity-Inspired Visual Parameter-Efficient Fine-Tuning for Medical Diagnosis—0
DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank DistributionCode0
Trans-LoRA: towards data-free Transferable Parameter Efficient Finetuning—0
Self-Corrected Multimodal Large Language Model for End-to-End Robot Manipulation—0
PatchProt: Hydrophobic patch prediction using protein foundation modelsCode0
BiSup: Bidirectional Quantization Error Suppression for Large Language Models—0
Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt AdaptationCode0
Pre-Trained Vision-Language Models as Partial Annotators—0
FeTT: Continual Class Incremental Learning via Feature Transformation Tuning—0
HARIS: Human-Like Attention for Reference Image Segmentation—0
SPD-CFL: Stepwise Parameter Dropout for Efficient Continual Federated Learning—0
Tell Me Why: Explainable Public Health Fact-Checking with Large Language ModelsCode0
DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation—0
Selective Fine-tuning on LLM-labeled Data May Reduce Reliance on Human Annotation: A Case Study Using Schedule-of-Event Table Detection—0
Parameter-Efficient Fine-Tuning With Adapters—0
CourseGPT-zh: an Educational Large Language Model Based on Knowledge Distillation Incorporating Prompt Optimization—0
Refining Joint Text and Source Code Embeddings for Retrieval Task with Parameter-Efficient Fine-TuningCode0
ELiTe: Efficient Image-to-LiDAR Knowledge Transfer for Semantic Segmentation—0
Enhancing News Summarization with ELearnFit through Efficient In-Context Learning and Efficient Fine-Tuning—0
TartuNLP at EvaLatin 2024: Emotion Polarity Detection—0
Investigating Automatic Scoring and Feedback using Large Language Models—0
MoPEFT: A Mixture-of-PEFTs for the Segment Anything Model—0
RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization—0
SPAFIT: Stratified Progressive Adaptation Fine-tuning for Pre-trained Large Language Models—0
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition—0
Parameter-Efficient Tuning Large Language Models for Graph Representation Learning—0
Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Models—0
Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devices—0
External Prompt Features Enhanced Parameter-efficient Fine-tuning for Salient Object Detection—0
ColA: Collaborative Adaptation with Gradient LearningCode0
Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications—0
iTBLS: A Dataset of Interactive Conversations Over Tabular Information—0
Mixed Text Recognition with Efficient Parameter Fine-Tuning and Transformer—0
TartuNLP @ SIGTYP 2024 Shared Task: Adapting XLM-RoBERTa for Ancient and Historical Languages—0
Skeleton: A New Framework for Accelerating Language Models via Task Neuron Localized Prompt Tuning—0
Exact and Efficient Unlearning for Large Language Model-based Recommendation—0
Shears: Unstructured Sparsity with Neural Low-rank Adapter Search—0
LoRA Dropout as a Sparsity Regularizer for Overfitting Control—0
Show:102550
← PrevPage 15 of 19Next →
All datasetsBoolQHellaSwagWinoGrande

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )82.63—Unverified
2LLaMA2-7bAccuracy (% )82.63—Unverified
3LLaMA2-7bAccuracy (% )81.93—Unverified
4LLaMA2-7bAccuracy (% )80.28—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )76.68—Unverified
2LLaMA2-7bAccuracy (% )76.67—Unverified
3LLaMA2-7bAccuracy (% )76.27—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )70.8—Unverified
2LLaMA2-7bAccuracy (% )70.09—Unverified
3LLaMA2-7bAccuracy (% )69.85—Unverified