Evaluating the effects of interactivity in a post-editing workbench
Nancy Underwood, Bartolom{\'e} Mesa-Lao, Mercedes Garc{\'\i}a Mart{\'\i}nez, Michael Carl, Vicent Alabau, Jes{\'u}s Gonz{\'a}lez-Rubio, Luis A. Leiva, Germ{\'a}n Sanchis-Trilles, Daniel Ort{\'\i}z-Mart{\'\i}nez, Francisco Casacuberta
Unverified — Be the first to reproduce this paper.
ReproduceAbstract
This paper describes the field trial and subsequent evaluation of a post-editing workbench which is currently under development in the EU-funded CasMaCat project. Based on user evaluations of the initial prototype of the workbench, this second prototype of the workbench includes a number of interactive features designed to improve productivity and user satisfaction. Using CasMaCat's own facilities for logging keystrokes and eye tracking, data were collected from nine post-editors in a professional setting. These data were then used to investigate the effects of the interactive features on productivity, quality, user satisfaction and cognitive load as reflected in the post-editorsÂ’ gaze activity. These quantitative results are combined with the qualitative results derived from user questionnaires and interviews conducted with all the participants.