This thesis contributes an evaluation of state-of-the-art dataflow models of computation regarding their suitability for a model-based design and analysis of human activity recognition systems, in terms of expressiveness and analyzability, as well as model accuracy. Different aspects of state-of-the-art human activity recognition systems have been modeled and analyzed. Based on existing methods, novel analysis approaches have been developed to acquire extra-functional properties like processor utilization, data communication rates, and finally energy consumption of the system.eng
Learn How to Design and Implement HAR Systems The pervasiveness and range of capabilities of today's mobile devices have enabled a wide spectrum of mobile applications that are transforming our daily lives, from smartphones equipped with GPS to integrated mobile sensors that acquire physiological data. Human Activity Recognition: Using Wearable Sen
In the past decade, Human Activity Recognition (HAR) has been an important part of the regular day to day life of many people. Activity recognition has wide applications in the field of health care, remote monitoring of elders, sports, biometric authentication, e-commerce and more. Each HAR application needs a unique approach to provide solutions driven by the context of the problem. In this dissertation, we are primarily discussing two application of HAR in different contexts. First, we design a novel approach for in-home, fine-grained activity recognition using multimodal wearable sensors on multiple body positions, along with very small Bluetooth beacons deployed in the environment. State-of-the-art in-home activity recognition schemes with wearable devices are mostly capable of detecting coarse-grained activities (sitting, standing, walking, or lying down), but cannot distinguish complex activities (sitting on the floor versus on the sofa or bed). Such schemes are not effective for emerging critical healthcare applications for example, in remote monitoring of patients with Alzheimer's disease, Bulimia, or Anorexia because they require a more comprehensive, contextual, and fine-grained recognition of complex daily user activities. Second, we introduced Watch-Dog a self-harm activity recognition engine, which attempts to infer self-harming activities from sensing accelerometer data using wearable sensors worn on a subject's wrist. In the United States, there are more than 35,000 reported suicides with approximately 1,800 of them being psychiatric inpatients every year. Staff perform intermittent or continuous observations in order to prevent such tragedies, but a study of 98 articles over time showed that 20% to 62% of suicides happened while inpatients were on an observation schedule. Reducing the instances of suicides of inpatients is a problem of critical importance to both patients and healthcare providers. Watch-dog uses supervised learning algorithm to model the system which can discriminate the harmful activities from non-harmful activities. The system is not only very accurate but also energy efficient. Apart from these two HAR systems, we also demonstrated the difference in activity pattern between elder and younger age group. For this experiment, we used 5 activities of daily living (ADL). Based on our findings we recommend that a context aware age-specific HAR model would be a better solution than all age-mixed models. Additionally, we find that personalized models for each individual elder person perform better classification than mixed models.
Continuous monitoring and recognition of complex activities is valuable for understanding human behavior and providing activity-aware services. At the same time, recognizing complex activities requires both movement and location information that can quickly drain batteries on wearable devices. In this paper we introduce CPAM (Change Point Activity Monitoring), an energy-efficient strategy for recognizing and monitoring complex activities in real time. CPAM employs unsupervised change point detection to detect likely activity transition times. By selectively triggering activity recognition only during the detected change points, CPAM extends device battery life by 2.6 times while retaining the activity recognition performance of continuous sampling. We validate our approach by collecting smartwatch data and comparing the energy consumption between CPAM (triggered AR) and non-CPAM (continuous AR) cases. Results indicate that change point detection techniques can be effective for reducing the energy footprint of sensor-based mobile applications and that automated activity labels can be used to estimate values of sensors between sampling periods.
The book first defines the problems, various concepts and notions related to activity recognition, and introduces the fundamental rationale and state-of-the-art methodologies and approaches. It then describes the use of artificial intelligence techniques and advanced knowledge technologies for the modelling and lifecycle analysis of human activities and behaviours based on real-time sensing observations from sensor networks and the Internet of Things. It also covers inference and decision-support methods and mechanisms, as well as personalization and adaptation techniques, which are required for emerging smart human-machine pervasive systems, such as self-management and assistive technologies in smart healthcare. Each chapter includes theoretical background, technological underpinnings and practical implementation, and step-by-step information on how to address and solve specific problems in topical areas. This monograph can be used as a textbook for postgraduate and PhD students on courses such as computer systems, pervasive computing, data analytics and digital health. It is also a valuable research reference resource for postdoctoral candidates and academics in relevant research and application domains, such as data analytics, smart cities, smart energy, and smart healthcare, to name but a few. Moreover, it offers smart technology and application developers practical insights into the use of activity recognition and behaviour analysis in state-of-the-art cyber-physical systems. Lastly, it provides healthcare solution developers and providers with information about the opportunities and possible innovative solutions for personalized healthcare and stratified medicine.
Learn How to Design and Implement HAR Systems The pervasiveness and range of capabilities of today’s mobile devices have enabled a wide spectrum of mobile applications that are transforming our daily lives, from smartphones equipped with GPS to integrated mobile sensors that acquire physiological data. Human Activity Recognition: Using Wearable Sensors and Smartphones focuses on the automatic identification of human activities from pervasive wearable sensors—a crucial component for health monitoring and also applicable to other areas, such as entertainment and tactical operations. Developed from the authors’ nearly four years of rigorous research in the field, the book covers the theory, fundamentals, and applications of human activity recognition (HAR). The authors examine how machine learning and pattern recognition tools help determine a user’s activity during a certain period of time. They propose two systems for performing HAR: Centinela, an offline server-oriented HAR system, and Vigilante, a completely mobile real-time activity recognition system. The book also provides a practical guide to the development of activity recognition applications in the Android framework.
The average age of people has increased due to advances in health sciences, which has led to an increase in the elderly population. This is positive news, but it also raises questions about the quality of independent living for older people. Clinicians use Activities of Daily Living (ADLs) to assess older people's ability to live independently. In recent years, portable computing devices have become more present in our daily lives. Therefore, a software system that can detect ADLs based on sensor data collected from wearable devices is beneficial for detecting health problems and supporting health care. In this context, this book presents several machine learning-based approaches for human activity recognition (HAR) using time-series data collected by wearable sensors in the home environment. In the first part of the book, machine learning-based approaches for atomic activity recognition are presented, which are relatively simple and short-term activities. In the second part, the algorithms for detecting long-term and complex ADLs are presented. In this part, a two-stage recognition framework is also presented, as well as an online recognition system for continuous monitoring of HAR. In the third and final part, a novel approach is proposed that not only solves the problem of data scarcity but also improves the performance of HAR by implementing multitask learning-based methods. The proposed approach simultaneously trains the models of short- and long-term activities, regardless of their temporal scale. The results show that the proposed approach improves classification performance compared to single-task learning.
This book is a truly comprehensive, timely, and very much needed treatise on the conceptualization of analysis, and design of contactless & multimodal sensor-based human activities, behavior understanding & intervention. From an interaction design perspective, the book provides views and methods that allow for more safe, trustworthy, efficient, and more natural interaction with technology that will be embedded in our daily living environments. The chapters in this book cover sufficient grounds and depth in related challenges and advances in sensing, signal processing, computer vision, and mathematical modeling. It covers multi-domain applications, including surveillance and elderly care that will be an asset to entry-level and practicing engineers and scientists.(See inside for the reviews from top experts)
Activity recognition has emerged as a challenging and high-impact research field, as over the past years smaller and more powerful sensors have been introduced in wide-spread consumer devices. Validation of techniques and algorithms requires large-scale human activity corpuses and improved methods to recognize activities and the contexts in which they occur. This book deals with the challenges of designing valid and reproducible experiments, running large-scale dataset collection campaigns, designing activity and context recognition methods that are robust and adaptive, and evaluating activity recognition systems in the real world with real users.
This book offer clear descriptions of the basic structure for the recognition and classification of human activities using different types of sensor module and smart devices in e.g. healthcare, education, monitoring the elderly, daily human behavior, and fitness monitoring. In addition, the complexities, challenges, and design issues involved in data collection, processing, and other fundamental stages along with datasets, methods, etc., are discussed in detail. The book offers a valuable resource for readers in the fields of pattern recognition, human–computer interaction, and the Internet of Things.
