The Classical Language Toolkit: An NLP Framework for Pre-Modern Languages
Kyle P. Johnson, Patrick J. Burns, John Stewart, Todd Cook, Cl{\'e}ment Besnier, William J. B. Mattingly
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/cltk/cltkOfficialIn papernone★ 900
Abstract
This paper announces version 1.0 of the Classical Language Toolkit (CLTK), an NLP framework for pre-modern languages. The vast majority of NLP, its algorithms and software, is created with assumptions particular to living languages, thus neglecting certain important characteristics of largely non-spoken historical languages. Further, scholars of pre-modern languages often have different goals than those of living-language researchers. To fill this void, the CLTK adapts ideas from several leading NLP frameworks to create a novel software architecture that satisfies the unique needs of pre-modern languages and their researchers. Its centerpiece is a modular processing pipeline that balances the competing demands of algorithmic diversity with pre-configured defaults. The CLTK currently provides pipelines, including models, for almost 20 languages.