SignBank+: Preparing a Multilingual Sign Language Dataset for Machine Translation Using Large Language Models

Code

• github.com/sign-language-processing/signbank-plus
  OfficialIn papernone★ 21
• github.com/sign-language-processing/signwriting-evaluation
  none★ 4

Abstract

We introduce SignBank+, a clean version of the SignBank dataset, optimized for machine translation between spoken language text and SignWriting, a phonetic sign language writing system. In addition to previous work that employs complex factorization techniques to enable translation between text and SignWriting, we show that a traditional text-to-text translation approach performs equally effectively on the cleaned SignBank+ dataset. Our evaluation results indicate that models trained on SignBank+ surpass those on the original dataset, establishing a new benchmark for SignWriting-based sign language translation and providing an open resource for future research.

Tasks

Reproductions