SOTAVerified

parameter-efficient fine-tuning

Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.

Papers

Showing 851875 of 935 papers

TitleStatusHype
On the Analysis of Cross-Lingual Prompt Tuning for Decoder-based Multilingual Model0
Low-Rank Adaptation for Multilingual Summarization: An Empirical Study0
PEMA: An Offsite-Tunable Plug-in External Memory Adaptation for Language ModelsCode0
Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse FinetuningCode0
BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing0
FedPEAT: Convergence of Federated Learning, Parameter-Efficient Fine Tuning, and Emulator Assisted Tuning for Artificial Intelligence Foundation Models with Mobile Edge Computing0
Improving Few-shot Generalization of Safety Classifiers via Data Augmented Parameter-Efficient Fine-Tuning0
Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models0
Improving generalization in large language models by learning prefix subspacesCode0
Contextual Refinement of Translations: Large Language Models for Sentence and Document-Level Post-Editing0
Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language ModelCode0
Non-Intrusive Adaptation: Input-Centric Parameter-efficient Fine-Tuning for Versatile Multimodal Modeling0
Prototype-based HyperAdapter for Sample-Efficient Multi-task TuningCode0
QFT: Quantized Full-parameter Tuning of LLMs with Affordable Resources0
TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained Models0
Parameterizing Context: Unleashing the Power of Parameter-Efficient Fine-Tuning and In-Context Tuning for Continual Table Semantic Parsing0
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning0
Conversational Factor Information Retrieval Model (ConFIRM)Code0
PETA: Parameter-Efficient Trojan Attacks0
LoRA ensembles for large language model fine-tuning0
Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities0
LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression0
PEFTT: Parameter-Efficient Fine-Tuning for low-resource Tibetan pre-trained language models0
Sparsely Shared LoRA on Whisper for Child Speech Recognition0
Test-Time Training for Speech0
Show:102550
← PrevPage 35 of 38Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )82.63Unverified
2LLaMA2-7bAccuracy (% )82.63Unverified
3LLaMA2-7bAccuracy (% )81.93Unverified
4LLaMA2-7bAccuracy (% )80.28Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )76.68Unverified
2LLaMA2-7bAccuracy (% )76.67Unverified
3LLaMA2-7bAccuracy (% )76.27Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA2-7bAccuracy (% )70.8Unverified
2LLaMA2-7bAccuracy (% )70.09Unverified
3LLaMA2-7bAccuracy (% )69.85Unverified