SOTAVerified

Task Arithmetic

A task vector specifies a direction in the weight space of a pre-trained model, such that movement in that direction improves performance on the task. We build task vectors by subtracting the weights of a pre-trained model from the weights of the same model after fine-tuning on a task. We show that these task vectors can be modified and combined together through arithmetic operations such as negation and addition, and the behavior of the resulting model is steered accordingly.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–61 of 61 papers

TitleStatusHype
Towards Diverse Device Heterogeneous Federated Learning via Task Arithmetic Knowledge IntegrationCode0
Task Arithmetic for Language Expansion in Speech Translation—0
MetaGPT: Merging Large Language Models Using Model Exclusive Task Arithmetic—0
On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion—0
Task Arithmetic can Mitigate Synthetic-to-Real Gap in Automatic Speech Recognition—0
HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Task—0
To Each (Textual Sequence) Its Own: Improving Memorized-Data Unlearning in Large Language Models—0
No Train but Gain: Language Arithmetic for training-free Language Adapters enhancementCode0
Ethos: Rectifying Language Models in Orthogonal Parameter Space—0
Language and Task Arithmetic with Parameter-Efficient Layers for Zero-Shot Summarization—0
Task Arithmetic with LoRA for Continual Learning—0
Show:102550
← PrevPage 3 of 3Next →

No leaderboard results yet.