With the advent of digital transformation, information and communications technology innovations have also led to a “data revolution” wherein more data is being captured, produced, stored, accessed, analyzed, archived, and reanalyzed at an exponential pace. An examination of new data sources, including big data and crowd-sourced data, can complement traditional sources of statistics and unlock insights that can ultimately lead to interventions for better outcomes by informing policies and actions toward attaining robust, sustainable, and inclusive development. This study will examine PIDS website download data and Twitter data to illustrate stories obtained from new data sources and explore how access, analysis, and use of new data sources can be promoted. Several quantitative tools are used on these new data sources, including (a) market basket analysis for website download data, (b) text mining (and sentiment analysis) for web scraped Twitter data, and (c) other big data analytics tools. Policy issues are also discussed, including risk management for using these new data sources.
Comments to this paper are welcome within 60 days from the date of posting. Email publications@pids.gov.ph.