Are ambiguous conjunctions problematic for machine translation?

Abstract

The translation of ambiguous words still poses challenges for machine translation. In this work, we carry out a systematic quantitative analysis regarding the ability of different machine translation systems to disambiguate the source language conjunctions ``but'' and ``and''. We evaluate specialised test sets focused on the translation of these two conjunctions. The test sets contain source languages that do not distinguish different variants of the given conjunction, whereas the target languages do. In total, we evaluate the conjunction ``but'' on 20 translation outputs, and the conjunction ``and'' on 10. All machine translation systems almost perfectly recognise one variant of the target conjunction, especially for the source conjunction ``but''. The other target variant, however, represents a challenge for machine translation systems, with accuracy varying from 50\% to 95\% for ``but'' and from 20\% to 57\% for ``and''. The major error for all systems is replacing the correct target variant with the opposite one.

Tasks

Reproductions