SOTAVerified

parameter-efficient fine-tuning

Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.

Papers

Showing 801850 of 935 papers

TitleStatusHype
NOTE: Notable generation Of patient Text summaries through Efficient approach based on direct preference optimization0
Offline Policy Learning via Skill-step Abstraction for Long-horizon Goal-Conditioned Tasks0
OMoE: Diversifying Mixture of Low-Rank Adaptation by Orthogonal Finetuning0
On Fairness of Task Arithmetic: The Role of Task Vectors0
On the Analysis of Cross-Lingual Prompt Tuning for Decoder-based Multilingual Model0
Towards Inducing Document-Level Abilities in Standard Multilingual Neural Machine Translation Models0
Optimising Language Models for Downstream Tasks: A Post-Training Perspective0
Optimization-Inspired Few-Shot Adaptation for Large Language Models0
Optimizing Language Models for Grammatical Acceptability: A Comparative Study of Fine-Tuning Techniques0
OrchMoE: Efficient Multi-Adapter Learning with Task-Skill Synergy0
OSoRA: Output-Dimension and Singular-Value Initialized Low-Rank Adaptation0
Parameter-Efficient Active Learning for Foundational models0
Parameter-efficient Adaptation of Multilingual Multimodal Models for Low-resource ASR0
Parameter-efficient Bayesian Neural Networks for Uncertainty-aware Depth Estimation0
Parameter-Efficient Checkpoint Merging via Metrics-Weighted Averaging0
Parameter-Efficient Continual Fine-Tuning: A Survey0
Parameter Efficient Continual Learning with Dynamic Low-Rank Adaptation0
Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications0
Parameter-Efficient Fine-Tuning Design Spaces0
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective0
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey0
Parameter-Efficient Fine-Tuning for Medical Image Analysis: The Missed Opportunity0
Parameter Efficient Fine Tuning for Multi-scanner PET to PET Reconstruction0
Parameter-efficient Fine-tuning in Hyperspherical Space for Open-vocabulary Semantic Segmentation0
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies0
Parameter-Efficient Fine-Tuning Medical Multimodal Large Language Models for Medical Visual Grounding0
Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment0
Parameter-Efficient Fine-Tuning of Multispectral Foundation Models for Hyperspectral Image Classification0
Parameter-Efficient Fine-Tuning of Large Language Models using Semantic Knowledge Tuning0
Parameter-Efficient Fine-Tuning of Large Language Models for Unit Test Generation: An Empirical Study0
Parameter-Efficient Fine-Tuning via Circular Convolution0
Parameter Efficient Fine-tuning via Cross Block Orchestration for Segment Anything Model0
Parameter-Efficient Fine-Tuning via Selective Discrete Cosine Transform0
Parameter-Efficient Fine-Tuning With Adapters0
Parameter-Efficient Fine-Tuning with Column Space Projection0
Parameter Efficient Mamba Tuning via Projector-targeted Diagonal-centric Linear Transformation0
Low-Rank Adaptation for Multilingual Summarization: An Empirical Study0
Parameter-Efficient Tuning Large Language Models for Graph Representation Learning0
Parameterizing Context: Unleashing the Power of Parameter-Efficient Fine-Tuning and In-Context Tuning for Continual Table Semantic Parsing0
Partial Fine-Tuning: A Successor to Full Fine-Tuning for Vision Transformers0
PC-LoRA: Low-Rank Adaptation for Progressive Model Compression with Knowledge Distillation0
PEDRO: Parameter-Efficient Fine-tuning with Prompt DEpenDent Representation MOdification0
PEFT A2Z: Parameter-Efficient Fine-Tuning Survey for Large Language and Vision Models0
PEFT-as-an-Attack! Jailbreaking Language Models during Federated Parameter-Efficient Fine-Tuning0
PEFTDebias : Capturing debiasing information using PEFTs0
PEFT-MedAware: Large Language Model for Medical Awareness0
PEFTT: Parameter-Efficient Fine-Tuning for low-resource Tibetan pre-trained language models0
PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning0
PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model0
PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization0
Show:102550
← PrevPage 17 of 19Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )82.63Unverified
2LLaMA2-7bAccuracy (% )82.63Unverified
3LLaMA2-7bAccuracy (% )81.93Unverified
4LLaMA2-7bAccuracy (% )80.28Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )76.68Unverified
2LLaMA2-7bAccuracy (% )76.67Unverified
3LLaMA2-7bAccuracy (% )76.27Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )70.8Unverified
2LLaMA2-7bAccuracy (% )70.09Unverified
3LLaMA2-7bAccuracy (% )69.85Unverified