SOTAVerified

Automatic Detection of Research Values from Scientific Abstracts Across Computer Science Subfields

2025-02-23Code Available0· sign in to hype

Hang Jiang, Tal August, Luca Soldaini, Kyle Lo, Maria Antoniak

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

The field of Computer science (CS) has rapidly evolved over the past few decades, providing computational tools and methodologies to various fields and forming new interdisciplinary communities. This growth in CS has significantly impacted institutional practices and relevant research communities. Therefore, it is crucial to explore what specific research values, known as basic and fundamental beliefs that guide or motivate research attitudes or actions, CS-related research communities promote. Prior research has manually analyzed research values from a small sample of machine learning papers. No prior work has studied the automatic detection of research values in CS from large-scale scientific texts across different research subfields. This paper introduces a detailed annotation scheme featuring ten research values that guide CS-related research. Based on the scheme, we build value classifiers to scale up the analysis and present a systematic study over 226,600 paper abstracts from 32 CS-related subfields and 86 popular publishing venues over ten years.

Reproductions