No longer lost in translation: Evidence that Google Translate works for comparative Bag-of-Words Text Applications

Erik De Vries, Martijn Schoonvelde, Gijs Schumacher*

*Corresponding author for this work

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

Automated text analysis allows researchers to analyze large quantities of text. Yet, comparative researchers are presented with a big challenge: across countries people speak different languages. To address this issue, some analysts have suggested using Google Translate to convert all texts into English before starting the analysis (Lucas et al. 2015). But in doing so, do we get lost in translation? This paper evaluates the usefulness of machine translation for bag-of-words models-such as topic models. We use the europarl dataset and compare term-document matrices (TDMs) as well as topic model results from gold standard translated text and machine-translated text. We evaluate results at both the document and the corpus level. We first find TDMs for both text corpora to be highly similar, with minor differences across languages. What is more, we find considerable overlap in the set of features generated from human-translated and machine-translated texts. With regard to LDA topic models, we find topical prevalence and topical content to be highly similar with again only small differences across languages. We conclude that Google Translate is a useful tool for comparative researchers when using bag-of-words text models.

Original languageEnglish
Pages (from-to)417-430
Number of pages14
JournalPolitical Analysis
Volume26
Issue number4
Early online date11 Sep 2018
DOIs
Publication statusPublished - Oct 2018

Keywords

  • automated content analysis
  • bag-of-words models
  • Google Translate
  • LDA
  • statistical analysis of texts

Fingerprint Dive into the research topics of 'No longer lost in translation: Evidence that Google Translate works for comparative Bag-of-Words Text Applications'. Together they form a unique fingerprint.

Cite this