The economic and political situation of cities has shifted in recent years in light of rapid growth amidst infrastructure decline, the suburbanization of poverty and inner city revitalization. At the same time, the way that data are used to understand urban systems has changed dramatically. Urban Analytics offers a field-defining look at the challenges and opportunities of using new and emerging data to study contemporary and future cities through methods including GIS, Remote Sensing, Big Data and Geodemographics. Written in an accessible style and packed with illustrations and interviews from key urban analysts, this is a groundbreaking new textbook for students of urban planning, urban design, geography, and the information sciences.
Increasing traffic congestion, vehicle emissions and commuters delay have been major challenges for urban transportation systems for years. The economic cost of traffic congestion in the US is Increasing from 200 billion in 2013 to 293 billion in 2030. There is an increasing need for a better solution to long-term transportation demand forecasting for urban infrastructure planning, and solution to short-term traffic prediction for managing existing urban infrastructure. Accordingly, understanding how urban systems operate and evolve through modeling individuals' daily urban activities has been a major focus of transportation planners, urban planners, and geographers. Traffic data (loop sensors, surveillance cameras, and GPS in taxis, buses), survey data (ACS, CHTS), mobile phone signals (CDR and GPS) and Location Based Social Network (LBSN) data (Facebook, Twitter, Yelp, and Foursquare) have enabled data-driven research on transportation behavior research. The data-driven research, urban data analytics, is an interdisciplinary field where machine learning/ deep learning methods from computer science and optimization/ simulation methods from operation research are applied in conventional city-related fields using spatial-temporal data. In this dissertation, we aim to add the third dimension, social, to urban data analytics research using social-spatial-temporal data, whose key topic is understanding how friendship influences human behavior over time and space. In this era of transformative mobility, this can help better design policies and investment strategies for managing existing urban infrastructure and forecasting future urban infrastructure planning. In this dissertation, we explored two research directions on social-enabled urban data analytics. First, we developed new machine learning models for social discrete choice model, bridging the gap between discrete choice modeling research and computer science research. Second, we developed a methodology framework for synthetic population synthesis using both small data and big data. The first part of the dissertation focus on modeling social influence on human behavior from a graph modeling perspective, while conforming to the discrete choice modeling framework. The proposed models can be used to model how friends influence individual's travel mode choice and other transportation related choices, which is important to transportation demand forecasting. We propose two novel models with scalable training algorithms: local logistics graph regularization (LLGR) and latent class graph regularization (LCGR) models. We add social regularization to represent similarity between friends, and we introduce latent classes to account for possible preference discrepancies between different social groups. Training of the LLGR model is performed using alternating direction method of multipliers (ADMM), and training of the LCGR model is performed using a specialized Monte Carlo expectation maximization (MCEM) algorithm. Scalability to large graphs is achieved by parallelizing computation in both the expectation and the maximization steps. The LCGR model is the first latent class classification model that incorporates social relationships among individuals represented by a given graph. To evaluate our two models, we consider three classes of data: small synthetic data to illustrate the knobs of the method, small real data to illustrate one social science use case, and large real data to illustrate a typical large-scale use case in the internet and social media applications. We experiment on synthetic datasets to empirically explain when the proposed model is better than vanilla classification models that do not exploit graph structure. We illustrate how the graph structure and labels, assigned to each node of the graph, need to satisfy certain reasonable properties. We also experiment on real-world data, including both small scale and large scale real-world datasets, to demonstrate on which types of datasets our model can be expected to outperform state-of-the-art models. This dissertation also develops an algorithmic procedure to incorporate social information into population synthesizer, which is an essential step to incorporate social information into the transportation simulation framework. Agent-based modeling in transportation problems requires detailed information on each of the agents that represent the population in the region of a study. To extend the agent-based transportation modeling with social influence, a connected synthetic population with both synthetic features and its social networks need to be simulated. However, either the traditional manually-collected household survey data (ACS) or the recent large-scale passively-collected Call Detail Records (CDR) alone lacks features. This work proposes an algorithmic procedure that makes use of both traditional survey data as well as digital records of networking and human behaviors to generate connected synthetic populations. This proposed framework for connected population synthesis is applicable to cities or metropolitan regions where data availability allows for the estimation of the component models. The generated populations coupled with recent advances in graph (social networks) algorithms can be used for testing transportation simulation scenarios with different social factors.
The use of data science and urban analytics has become a defining feature of smart cities. This timely book is a clear guide to the use of social media data for urban analytics. The book presents the foundations of urban analytics with social media data, along with real-world applications and insights on the platforms we use today. It looks at social media analytics platforms, cyberphysical data analytics platforms, crowd detection platforms, City-as-a-Platform, and city-as-a-sensor for platform urbanism. The book provides examples to illustrate how we apply and analyse social media data to determine disaster severity, assist authorities with pandemic policy, and capture public perception of smart cities. This will be a useful reference for those involved with and researching social, data, and urban analytics and informatics.
This open access book explores ways to leverage information technology and machine learning to combat disease and promote health, especially in resource-constrained settings. It focuses on digital disease surveillance through the application of machine learning to non-traditional data sources. Developing countries are uniquely prone to large-scale emerging infectious disease outbreaks due to disruption of ecosystems, civil unrest, and poor healthcare infrastructure – and without comprehensive surveillance, delays in outbreak identification, resource deployment, and case management can be catastrophic. In combination with context-informed analytics, students will learn how non-traditional digital disease data sources – including news media, social media, Google Trends, and Google Street View – can fill critical knowledge gaps and help inform on-the-ground decision-making when formal surveillance systems are insufficient.
We are living at the dawn of what has been termed ‘the fourth paradigm of science,’ a scientific revolution that is marked by both the emergence of big data science and analytics, and by the increasing adoption of the underlying technologies in scientific and scholarly research practices. Everything about science development or knowledge production is fundamentally changing thanks to the ever-increasing deluge of data. This is the primary fuel of the new age, which powerful computational processes or analytics algorithms are using to generate valuable knowledge for enhanced decision-making, and deep insights pertaining to a wide variety of practical uses and applications. This book addresses the complex interplay of the scientific, technological, and social dimensions of the city, and what it entails in terms of the systemic implications for smart sustainable urbanism. In concrete terms, it explores the interdisciplinary and transdisciplinary field of smart sustainable urbanism and the unprecedented paradigmatic shifts and practical advances it is undergoing in light of big data science and analytics. This new era of science and technology embodies an unprecedentedly transformative and constitutive power—manifested not only in the form of revolutionizing science and transforming knowledge, but also in advancing social practices, producing new discourses, catalyzing major shifts, and fostering societal transitions. Of particular relevance, it is instigating a massive change in the way both smart cities and sustainable cities are studied and understood, and in how they are planned, designed, operated, managed, and governed in the face of urbanization. This relates to what has been dubbed data-driven smart sustainable urbanism, an emerging approach based on a computational understanding of city systems and processes that reduces urban life to logical and algorithmic rules and procedures, while also harnessing urban big data to provide a more holistic and integrated view or synoptic intelligence of the city. This is increasingly being directed towards improving, advancing, and maintaining the contribution of both sustainable cities and smart cities to the goals of sustainable development. This timely and multifaceted book is aimed at a broad readership. As such, it will appeal to urban scientists, data scientists, urbanists, planners, engineers, designers, policymakers, philosophers of science, and futurists, as well as all readers interested in an overview of the pivotal role of big data science and analytics in advancing every academic discipline and social practice concerned with data–intensive science and its application, particularly in relation to sustainability.
This open access book introduces readers to the vision on future cities and urban lives in connection with “Society 5.0”, which was proposed in the 5th Basic Science and Technology Plan by Japan’s national government for a technology-based, human-centered society, emerging from the fourth industrial revolution. The respective chapters summarize the findings and suggestions of joint research projects conducted by H-UTokyo Lab. Through the research collaboration and discussion, this book explores the future urban lives under the concept of “Society 5.0”, characterized by the key phrases of data-driven society, knowledge-intensive society, and non-monetary society, and suggests the directionality to which the concept should aim as Japan’s technology-led national vision. Written by Hitachi’s researchers as well as academics from a wide range of fields, including engineering, economics, psychology and philosophy at The University of Tokyo, the book is a must read for members of the general public interested in urban planning, students, professionals and researchers in engineering and economics.
This book showcases the different ways in which contemporary forms of data analysis are being used in urban planning and management. It highlights the emerging possibilities that city-regional governance, technology and data have for better planning and urban management - and discusses how you can apply them to your research. Including perspectives from across the globe, it’s packed with examples of good practice and helps to demystify the process of using big and open data. Learn about different kinds of emergent data sources and how they are processed, visualised and presented. Understand how spatial analysis and GIS are used in city planning. See examples of how contemporary data analytics methods are being applied in a variety of contexts, such as ‘smart’ city management and megacities. Aimed at upper undergraduate and postgraduate students studying spatial analysis and planning, this timely text is the perfect companion to enable you to apply data analytics approaches in your research.
A new era of innovation is enabled by the integration of social sciences and information systems research. In this context, the adoption of Big Data and analytics technology brings new insight to the social sciences. It also delivers new, flexible responses to crucial social problems and challenges. We are proud to deliver this edited volume on the social impact of big data research. It is one of the first initiatives worldwide analyzing of the impact of this kind of research on individuals and social issues. The organization of the relevant debate is arranged around three pillars: Section A: Big Data Research for Social Impact: • Big Data and Their Social Impact; • (Smart) Citizens from Data Providers to Decision-Makers; • Towards Sustainable Development of Online Communities; • Sentiment from Online Social Networks; • Big Data for Innovation. Section B. Techniques and Methods for Big Data driven research for Social Sciences and Social Impact: • Opinion Mining on Social Media; • Sentiment Analysis of User Preferences; • Sustainable Urban Communities; • Gender Based Check-In Behavior by Using Social Media Big Data; • Web Data-Mining Techniques; • Semantic Network Analysis of Legacy News Media Perception. Section C. Big Data Research Strategies: • Skill Needs for Early Career Researchers—A Text Mining Approach; • Pattern Recognition through Bibliometric Analysis; • Assessing an Organization’s Readiness to Adopt Big Data; • Machine Learning for Predicting Performance; • Analyzing Online Reviews Using Text Mining; • Context–Problem Network and Quantitative Method of Patent Analysis. Complementary social and technological factors including: • Big Social Networks on Sustainable Economic Development; Business Intelligence.
This book is intended to help explore the field of smart sustainable cities in its complexity, heterogeneity, and breadth, the many faces of a topical subject of major importance for the future that encompasses so much of modern urban life in an increasingly computerized and urbanized world. Indeed, sustainable urban development is currently at the center of debate in light of several ICT visions becoming achievable and deployable computing paradigms, and shaping the way cities will evolve in the future and thus tackle complex challenges. This book integrates computer science, data science, complexity science, sustainability science, system thinking, and urban planning and design. As such, it contains innovative computer–based and data–analytic research on smart sustainable cities as complex and dynamic systems. It provides applied theoretical contributions fostering a better understanding of such systems and the synergistic relationships between the underlying physical and informational landscapes. It offers contributions pertaining to the ongoing development of computer–based and data science technologies for the processing, analysis, management, modeling, and simulation of big and context data and the associated applicability to urban systems that will advance different aspects of sustainability. This book seeks to explicitly bring together the smart city and sustainable city endeavors, and to focus on big data analytics and context-aware computing specifically. In doing so, it amalgamates the design concepts and planning principles of sustainable urban forms with the novel applications of ICT of ubiquitous computing to primarily advance sustainability. Its strength lies in combining big data and context–aware technologies and their novel applications for the sheer purpose of harnessing and leveraging the disruptive and synergetic effects of ICT on forms of city planning that are required for future forms of sustainable development. This is because the effects of such technologies reinforce one another as to their efforts for transforming urban life in a sustainable way by integrating data–centric and context–aware solutions for enhancing urban systems and facilitating coordination among urban domains. This timely and comprehensive book is aimed at a wide audience across science, academia industry, and policymaking. It provides the necessary material to inform relevant research communities of the state–of–the–art research and the latest development in the area of smart sustainable urban development, as well as a valuable reference for planners, designers, strategists, and ICT experts who are working towards the development and implementation of smart sustainable cities based on big data analytics and context–aware computing.
This book introduces the latest thinking on the use of Big Data in the context of urban systems, including research and insights on human behavior, urban dynamics, resource use, sustainability and spatial disparities, where it promises improved planning, management and governance in the urban sectors (e.g., transportation, energy, smart cities, crime, housing, urban and regional economies, public health, public engagement, urban governance and political systems), as well as Big Data’s utility in decision-making, and development of indicators to monitor economic and social activity, and for urban sustainability, transparency, livability, social inclusion, place-making, accessibility and resilience.
