The U.S. Census Bureau maintains an important portfolio of economic statistics programs, including quinquennial economic censuses, annual economic surveys, and quarterly and monthly indicator surveys. Government, corporate, and academic users rely on the data to understand the complexity and dynamism of the U.S. economy. Historically, the Bureau's economic statistics programs developed sector by sector (e.g., separate surveys of manufacturing, retail trade, and wholesale trade), and they continue to operate largely independently. Consequently, inconsistencies in questionnaire content, sample and survey design, and survey operations make the data not only more difficult to use, but also more costly to collect and process and more burdensome to the business community than they could be. This report reviews the Census Bureau's annual economic surveys. Specifically, it examines the design, operations, and products of 11 surveys and makes recommendations to enable them to better answer questions about the evolving economy.
Beginning in 2006, the Census Bureau embarked on a program to reengineer the Survey of Income and Program Participation (SIPP) to reduce its costs and improve data quality and timeliness. The Bureau also requested the National Academies to consider the advantages and disadvantages of strategies for linking administrative records and survey data, taking account of the accessibility of relevant administrative records, the operational feasibility of linking, the quality and usefulness of the linked data, and the ability to provide access to the linked data while protecting the confidentiality of individual respondents. In response, this volume first examines the history of SIPP and reviews the survey's purpose, value, strengths, and weaknesses. The book examines alternative uses of administrative records in a reengineered SIPP and, finally, considers innovations in SIPP design and data collection, including the proposed use of annual interviews with an event history calendar.
U.S. business data are used broadly, providing the building blocks for key national-as well as regional and local-statistics measuring aggregate income and output, employment, investment, prices, and productivity. Beyond aggregate statistics, individual- and firm-level data are used for a wide range of microanalyses by academic researchers and by policy makers. In the United States, data collection and production efforts are conducted by a decentralized system of statistical agencies. This apparatus yields an extensive array of data that, particularly when made available in the form of microdata, provides an unparalleled resource for policy analysis and research on social issues and for the production of economic statistics. However, the decentralized nature of the statistical system also creates challenges to efficient data collection, to containment of respondent burden, and to maintaining consistency of terms and units of measurement. It is these challenges that raise to paramount importance the practice of effective data sharing among the statistical agencies. With this as the backdrop, the Bureau of Economic Analysis (BEA) asked the Committee on National Statistics of the National Academies to convene a workshop to discuss interagency business data sharing. The workshop was held October 21, 2005. This report is a summary of the discussions of that workshop. The workshop focused on the benefits of data sharing to two groups of stakeholders: the statistical agencies themselves and downstream data users. Presenters were asked to highlight untapped opportunities for productive data sharing that cannot yet be exploited because of regulatory or legislative constraints. The most prominently discussed example was that of tax data needed to reconcile the two primary business lists use by the statistical agencies.
Introduction.Big data for twenty-first-century economic statistics: the future is now /Katharine G. Abraham, Ron S. Jarmin, Brian C. Moyer, and Matthew D. Shapiro --Toward comprehensive use of big data in economic statistics.Reengineering key national economic indicators /Gabriel Ehrlich, John Haltiwanger, Ron S. Jarmin, David Johnson, and Matthew D. Shapiro ;Big data in the US consumer price index: experiences and plans /Crystal G. Konny, Brendan K. Williams, and David M. Friedman ;Improving retail trade data products using alternative data sources /Rebecca J. Hutchinson ;From transaction data to economic statistics: constructing real-time, high-frequency, geographic measures of consumer spending /Aditya Aladangady, Shifrah Aron-Dine, Wendy Dunn, Laura Feiveson, Paul Lengermann, and Claudia Sahm ;Improving the accuracy of economic measurement with multiple data sources: the case of payroll employment data /Tomaz Cajner, Leland D. Crane, Ryan A. Decker, Adrian Hamins-Puertolas, and Christopher Kurz --Uses of big data for classification.Transforming naturally occurring text data into economic statistics: the case of online job vacancy postings /Arthur Turrell, Bradley Speigner, Jyldyz Djumalieva, David Copple, and James Thurgood ;Automating response evaluation for franchising questions on the 2017 economic census /Joseph Staudt, Yifang Wei, Lisa Singh, Shawn Klimek, J. Bradford Jensen, and Andrew Baer ;Using public data to generate industrial classification codes /John Cuffe, Sudip Bhattacharjee, Ugochukwu Etudo, Justin C. Smith, Nevada Basdeo, Nathaniel Burbank, and Shawn R. Roberts --Uses of big data for sectoral measurement.Nowcasting the local economy: using Yelp data to measure economic activity /Edward L. Glaeser, Hyunjin Kim, and Michael Luca ;Unit values for import and export price indexes: a proof of concept /Don A. Fast and Susan E. Fleck ;Quantifying productivity growth in the delivery of important episodes of care within the Medicare program using insurance claims and administrative data /John A. Romley, Abe Dunn, Dana Goldman, and Neeraj Sood ;Valuing housing services in the era of big data: a user cost approach leveraging Zillow microdata /Marina Gindelsky, Jeremy G. Moulton, and Scott A. Wentland --Methodological challenges and advances.Off to the races: a comparison of machine learning and alternative data for predicting economic indicators /Jeffrey C. Chen, Abe Dunn, Kyle Hood, Alexander Driessen, and Andrea Batch ;A machine learning analysis of seasonal and cyclical sales in weekly scanner data /Rishab Guha and Serena Ng ;Estimating the benefits of new products /W. Erwin Diewert and Robert C. Feenstra.
