Working with JSON data: The case of SEC submissions data

Abstract

The purpose of this note is three-fold. First, I provide a hands-on introduction to hierarchical data that complements and builds on Chapter 23 of R for Data Science. Second, I aim to show how one can process JSON data provided by SEC EDGAR using submissions data as case study. Finally, I introduce what I call a batch-processing paradigm, which is a general approach that I believe is helpful for many significant data processing tasks.

Keywords: JSON, SEC, SEC EDGAR