Informing Policy with Text Mining: Technological Change and Social Challenges

47 Pages Posted: 2 May 2019

See all articles by Kristóf Gyódi

Kristóf Gyódi

University of Warsaw - Faculty of Economic Sciences

Łukasz Nawaro

University of Warsaw - Faculty of Economic Sciences; Digital Economy Lab UW, University of Warsaw

Michał Paliński

University of Warsaw - Faculty of Economic Sciences; Digital Economy Lab UW, University of Warsaw

Maciej Wilamowski

affiliation not provided to SSRN

Date Written: March 29, 2019

Abstract

The fast development and adoption of ICT technologies and digital services has major social implications. Policy-makers often struggle to design appropriate regulations, defend the rights of citizens and ensure competition. The aim of this work is to present various methodologies that support stakeholders with identification of emerging technologies and related social challenges based on the text mining of news articles. The analysis demonstrates that while each text mining algorithm provides insightful results, their combination yields more detailed and robust overview of media discussions. The results present early signals and trends, the relationships between technologies and social challenges, and changing attitudes towards selected tech issues.

Keywords: online news, web scraping, text mining, sentiment analysis, topic-modelling

JEL Classification: 033, 038

Suggested Citation

Gyódi, Kristóf and Nawaro, Łukasz and Paliński, Michał and Wilamowski, Maciej, Informing Policy with Text Mining: Technological Change and Social Challenges (March 29, 2019). Available at SSRN: https://ssrn.com/abstract=3362487 or http://dx.doi.org/10.2139/ssrn.3362487

Kristóf Gyódi

University of Warsaw - Faculty of Economic Sciences ( email )

Dluga Street 44/50
Warsaw, 00-241
Poland

Łukasz Nawaro

University of Warsaw - Faculty of Economic Sciences ( email )

Dluga Street 44/50
Warsaw, 00-241
Poland

Digital Economy Lab UW, University of Warsaw ( email )

Michał Paliński (Contact Author)

University of Warsaw - Faculty of Economic Sciences ( email )

Dluga Street 44/50
Warsaw, 00-241
Poland

Digital Economy Lab UW, University of Warsaw ( email )

Maciej Wilamowski

affiliation not provided to SSRN

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
57
Abstract Views
506
rank
391,418
PlumX Metrics