SOTAVerified

Task Arithmetic

A task vector specifies a direction in the weight space of a pre-trained model, such that movement in that direction improves performance on the task. We build task vectors by subtracting the weights of a pre-trained model from the weights of the same model after fine-tuning on a task. We show that these task vectors can be modified and combined together through arithmetic operations such as negation and addition, and the behavior of the resulting model is steered accordingly.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 41–50 of 61 papers

TitleStatusHype
BADTV: Unveiling Backdoor Threats in Third-Party Task Vectors—0
When Domain Generalization meets Generalized Category Discovery: An Adaptive Task-Arithmetic Driven Approach—0
Bias Vector: Mitigating Biases in Language Models with Task Arithmetic Approach—0
Multi-Task Model Merging via Adaptive Weight DisentanglementCode0
Task Arithmetic Through The Lens Of One-Shot Federated Learning—0
Beyond Task Vectors: Selective Task Arithmetic Based on Importance Metrics—0
ATM: Improving Model Merging by Alternating Tuning and Merging—0
Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging—0
The Non-Local Model Merging Problem: Permutation Symmetries and Variance Collapse—0
What Matters for Model Merging at Scale?—0
Show:102550
← PrevPage 5 of 7Next →

No leaderboard results yet.