Main Memory Database Systems
Main Memory Database Systems

Author: Frans Faerber

Publisher: Foundations and Trends in Databases

Published: 2017-07-20

Total Pages: 144

ISBN-13: 9781680833249

DOWNLOAD EBOOK

With growing memory sizes and memory prices dropping by a factor of 10 every 5 years, data having a "primary home" in memory is now a reality. Main-memory databases eschew many of the traditional architectural pillars of relational database systems that optimized for disk-resident data. The result of these memory-optimized designs are systems that feature several innovative approaches to fundamental issues (e.g., concurrency control, query processing) that achieve orders of magnitude performance improvements over traditional designs. This monograph provides an overview of recent developments in main-memory database systems. It covers five main issues and architectural choices that need to be made when building a high performance main-memory optimized database: data organization and storage, indexing, concurrency control, durability and recovery techniques, and query processing and compilation. The monograph focuses on four commercial and research systems: H-Store/VoltDB, Hekaton, HyPer, and SAPHANA. These systems are diverse in their design choices and form a representative sample of the state of the art in main-memory database systems. It also covers other commercial and academic systems, along with current and future research trends.

Main Memory Database Systems
Main Memory Database Systems

Author: Franz Faerber

Publisher:

Published: 2017

Total Pages: 130

ISBN-13: 9781680833256

DOWNLOAD EBOOK

This article provides an overview of recent developments in main-memory database systems. With growing memory sizes and memory prices dropping by a factor of 10 every 5 years, data having a "primary home" in memory is now a reality. Main-memory databases eschew many of the traditional architectural pillars of relational database systems that optimized for disk-resident data. The result of these memory-optimized designs are systems that feature several innovative approaches to fundamental issues (e.g., concurrency control, query processing) that achieve orders of magnitude performance improvements over traditional designs. Our survey covers five main issues and architectural choices that need to be made when building a high performance main-memory optimized database: data organization and storage, indexing, concurrency control, durability and recovery techniques, and query processing and compilation. We focus our survey on four commercial and research systems: H-Store/VoltDB, Hekaton, HyPer, and SAP HANA. These systems are diverse in their design choices and form a representative sample of the state of the art in main-memory database systems. We also cover other commercial and academic systems, along with current and future research trends.

Implementation techniques for main memory database systems
Implementation techniques for main memory database systems

Author: University of California, Berkeley. Electronics Research Laboratory. POSTGRES Project

Publisher:

Published: 1984

Total Pages: 23

ISBN-13:

DOWNLOAD EBOOK

With the availability of very large, relatively inexpensive main memories, it is becoming possible to keep large databases resident in main memory. This paper considers the changes necessary to permit a relational database system to take advantage of large amounts of main memory. The authors evaluate AVL vs. B+- tree access methods for main memory databases, hash-based query processing strategies vs. sort-merge, and study recovery issues when most or all of the database fits in main memory. As expected, B+- trees are the preferred storage mechanism unless more than 80-90% of the database fits in main memory. A somewhat surprising result is that hash based query processing strategies are advantageous for large memory situations. Keywords: Access; Algorithms. (Author).

In-Memory Data Management
In-Memory Data Management

Author: Hasso Plattner

Publisher: Springer Science & Business Media

Published: 2011-03-08

Total Pages: 245

ISBN-13: 3642193633

DOWNLOAD EBOOK

In the last 50 years the world has been completely transformed through the use of IT. We have now reached a new inflection point. Here we present, for the first time, how in-memory computing is changing the way businesses are run. Today, enterprise data is split into separate databases for performance reasons. Analytical data resides in warehouses, synchronized periodically with transactional systems. This separation makes flexible, real-time reporting on current data impossible. Multi-core CPUs, large main memories, cloud computing and powerful mobile devices are serving as the foundation for the transition of enterprises away from this restrictive model. We describe techniques that allow analytical and transactional processing at the speed of thought and enable new ways of doing business. The book is intended for university students, IT-professionals and IT-managers, but also for senior management who wish to create new business processes by leveraging in-memory computing.

Non-Volatile Memory Database Management Systems
Non-Volatile Memory Database Management Systems

Author: Joy Arulraj

Publisher: Springer Nature

Published: 2022-06-01

Total Pages: 173

ISBN-13: 3031018680

DOWNLOAD EBOOK

This book explores the implications of non-volatile memory (NVM) for database management systems (DBMSs). The advent of NVM will fundamentally change the dichotomy between volatile memory and durable storage in DBMSs. These new NVM devices are almost as fast as volatile memory, but all writes to them are persistent even after power loss. Existing DBMSs are unable to take full advantage of this technology because their internal architectures are predicated on the assumption that memory is volatile. With NVM, many of the components of legacy DBMSs are unnecessary and will degrade the performance of data-intensive applications. We present the design and implementation of DBMS architectures that are explicitly tailored for NVM. The book focuses on three aspects of a DBMS: (1) logging and recovery, (2) storage and buffer management, and (3) indexing. First, we present a logging and recovery protocol that enables the DBMS to support near-instantaneous recovery. Second, we propose a storage engine architecture and buffer management policy that leverages the durability and byte-addressability properties of NVM to reduce data duplication and data migration. Third, the book presents the design of a range index tailored for NVM that is latch-free yet simple to implement. All together, the work described in this book illustrates that rethinking the fundamental algorithms and data structures employed in a DBMS for NVM improves performance and availability, reduces operational cost, and simplifies software development.

Main Memory Databases
Main Memory Databases

Author: Sahir K. Mehta

Publisher:

Published: 1996

Total Pages: 168

ISBN-13:

DOWNLOAD EBOOK

"The declining cost of main memory coupled with higher performance expectations has inspired researchers and developers to look into systems with massive amounts of memory, especially for systems with databases. When memory is large enough, an entire database can permanently reside in main memory. These database systems are known as memory resident database or Main Memory DataBase (MMDB) systems. When a database is a main memory resident, systems can achieve significant performance improvements over traditional disk-based database systems by eliminating the overhead required to perform Input/Output operations. However, the problem of crash recovery becomes by far the most challenging issue in MMDB systems, since it can occur frequently and cause a drastic crisis by wiping out the entire content of the database. The kind of crisis that can be encountered due to memory failures, the way to prevent them from occuring in the first place, methods of dealing with them upon their occurance, strategies to make the system more reliable to avoid them in the future, and several other issues like these must be well understood. Approaches to deal with crash recoveries must be sound, well designed, and correctly implemented. The objective of this thesis is to study some of the pioneering works of researchers and developers in the area of MMDB recovery and to perform an in-depth analysis of MMDB recovery issues and approaches taken by several major recovery techniques. The analysis examines the reasons for these techniques, design and architecture, and their benefits and limitations over one another. My independent evaluation of the relative benefits and limitations of each technique coupled with marketablitiy analysis is also presented. The approach used in this study is different from that of other studies that have been published so far in this area. In this study, the reader is given a basic introduction to the topic and then gradually taken through the final stages of analysis and comparison of several recovery techniques."--Author's abstract.

Real-Time Database Systems
Real-Time Database Systems

Author: Azer Bestavros

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 376

ISBN-13: 1461561612

DOWNLOAD EBOOK

Despite the growing interest in Real-Time Database Systems, there is no single book that acts as a reference to academics, professionals, and practitioners who wish to understand the issues involved in the design and development of RTDBS. Real-Time Database Systems: Issues and Applications fulfills this need. This book presents the spectrum of issues that may arise in various real-time database applications, the available solutions and technologies that may be used to address these issues, and the open problems that need to be tackled in the future. With rapid advances in this area, several concepts have been proposed without a widely accepted consensus on their definitions and implications. To address this need, the first chapter is an introduction to the key RTDBS concepts and definitions, which is followed by a survey of the state of the art in RTDBS research and practice. The remainder of the book consists of four sections: models and paradigms, applications and benchmarks, scheduling and concurrency control, and experimental systems. The chapters in each section are contributed by experts in the respective areas. Real-Time Database Systems: Issues and Applications is primarily intended for practicing engineers and researchers working in the growing area of real-time database systems. For practitioners, the book will provide a much needed bridge for technology transfer and continued education. For researchers, this book will provide a comprehensive reference for well-established results. This book can also be used in a senior or graduate level course on real-time systems, real-time database systems, and database systems or closely related courses.

Main Memory Management on Relational Database Systems
Main Memory Management on Relational Database Systems

Author: Pedro Mejia Alvarez

Publisher: Springer Nature

Published: 2022-09-13

Total Pages: 115

ISBN-13: 3031132955

DOWNLOAD EBOOK

This book provides basic knowledge about main memory management in relational databases as it is needed to support large-scale applications processed completely in memory. In business operations, real-time predictability and high speed is a must. Hence every opportunity must be exploited to improve performance, including reducing dependency on the hard disk, adding more memory to make more data resident in the memory, and even deploying an in-memory system where all data can be kept in memory. The book provides one chapter for each of the main related topics, i.e. the memory system, memory management, virtual memory, and databases and their memory systems, and it is complemented by a short survey of six commercial systems: TimesTen, MySQL, VoltDB, Hekaton, HyPer/ScyPer, and SAP HANA.

Advanced Database Systems
Advanced Database Systems

Author: Nabil R. Adam

Publisher: Springer Science & Business Media

Published: 1993-12-08

Total Pages: 476

ISBN-13: 9783540575078

DOWNLOAD EBOOK

Database management is attracting wide interest in both academic and industrial contexts. New application areas such as CAD/CAM, geographic information systems, and multimedia are emerging. The needs of these application areas are far more complex than those of conventional business applications. The purpose of this book is to bring together a set of current research issues that addresses a broad spectrum of topics related to database systems and applications. The book is divided into four parts: - object-oriented databases, - temporal/historical database systems, - query processing in database systems, - heterogeneity, interoperability, open system architectures, multimedia database systems.

In-Memory Data Management
In-Memory Data Management

Author: Hasso Plattner

Publisher: Springer Science & Business Media

Published: 2012-04-17

Total Pages: 286

ISBN-13: 3642295754

DOWNLOAD EBOOK

In the last fifty years the world has been completely transformed through the use of IT. We have now reached a new inflection point. This book presents, for the first time, how in-memory data management is changing the way businesses are run. Today, enterprise data is split into separate databases for performance reasons. Multi-core CPUs, large main memories, cloud computing and powerful mobile devices are serving as the foundation for the transition of enterprises away from this restrictive model. This book provides the technical foundation for processing combined transactional and analytical operations in the same database. In the year since we published the first edition of this book, the performance gains enabled by the use of in-memory technology in enterprise applications has truly marked an inflection point in the market. The new content in this second edition focuses on the development of these in-memory enterprise applications, showing how they leverage the capabilities of in-memory technology. The book is intended for university students, IT-professionals and IT-managers, but also for senior management who wish to create new business processes.