As computation continues to move into the cloud, the computing platform of interest no longer resembles a pizza box or a refrigerator, but a warehouse full of computers. These new large datacenters are quite different from traditional hosting facilities of earlier times and cannot be viewed simply as a collection of co-located servers. Large portions of the hardware and software resources in these facilities must work in concert to efficiently deliver good levels of Internet service performance, something that can only be achieved by a holistic approach to their design and deployment. In other words, we must treat the datacenter itself as one massive warehouse-scale computer (WSC). We describe the architecture of WSCs, the main factors influencing their design, operation, and cost structure, and the characteristics of their software base. We hope it will be useful to architects and programmers of today’s WSCs, as well as those of future many-core platforms which may one day implement the equivalent of today’s WSCs on a single board. Notes for the Second Edition After nearly four years of substantial academic and industrial developments in warehouse-scale computing, we are delighted to present our first major update to this lecture. The increased popularity of public clouds has made WSC software techniques relevant to a larger pool of programmers since our first edition. Therefore, we expanded Chapter 2 to reflect our better understanding of WSC software systems and the toolbox of software techniques for WSC programming. In Chapter 3, we added to our coverage of the evolving landscape of wimpy vs. brawny server trade-offs, and we now present an overview of WSC interconnects and storage systems that was promised but lacking in the original edition. Thanks largely to the help of our new co-author, Google Distinguished Engineer Jimmy Clidaras, the material on facility mechanical and power distribution design has been updated and greatly extended (see Chapters 4 and 5). Chapters 6 and 7 have also been revamped significantly. We hope this revised edition continues to meet the needs of educators and professionals in this area.
This book describes warehouse-scale computers (WSCs), the computing platforms that power cloud computing and all the great web services we use every day. It discusses how these new systems treat the datacenter itself as one massive computer designed at warehouse scale, with hardware and software working in concert to deliver good levels of internet service performance. The book details the architecture of WSCs and covers the main factors influencing their design, operation, and cost structure, and the characteristics of their software base. Each chapter contains multiple real-world examples, including detailed case studies and previously unpublished details of the infrastructure used to power Google's online services. Targeted at the architects and programmers of today's WSCs, this book provides a great foundation for those looking to innovate in this fascinating and important area, but the material will also be broadly interesting to those who just want to understand the infrastructure powering the internet. The third edition reflects four years of advancements since the previous edition and nearly doubles the number of pictures and figures. New topics range from additional workloads like video streaming, machine learning, and public cloud to specialized silicon accelerators, storage and network building blocks, and a revised discussion of data center power and cooling, and uptime. Further discussions of emerging trends and opportunities ensure that this revised edition will remain an essential resource for educators and professionals working on the next generation of WSCs.
As computation continues to move into the cloud, the computing platform of interest no longer resembles a pizza box or a refrigerator, but a warehouse full of computers. These new large datacenters are quite different from traditional hosting facilities of earlier times and cannot be viewed simply as a collection of co-located servers. Large portions of the hardware and software resources in these facilities must work in concert to efficiently deliver good levels of Internet service performance, something that can only be achieved by a holistic approach to their design and deployment. In other words, we must treat the datacenter itself as one massive warehouse-scale computer (WSC). We describe the architecture of WSCs, the main factors influencing their design, operation, and cost structure, and the characteristics of their software base. We hope it will be useful to architects and programmers of today's WSCs, as well as those of future many-core platforms which may one day implement the equivalent of today's WSCs on a single board. Table of Contents: Introduction / Workloads and Software Infrastructure / Hardware Building Blocks / Datacenter Basics / Energy and Power Efficiency / Modeling Costs / Dealing with Failures and Repairs / Closing Remarks
This book describes warehouse-scale computers (WSCs), the computing platforms that power cloud computing and all the great web services we use every day. It discusses how these new systems treat the datacenter itself as one massive computer designed at warehouse scale, with hardware and software working in concert to deliver good levels of internet service performance. The book details the architecture of WSCs and covers the main factors influencing their design, operation, and cost structure, and the characteristics of their software base. Each chapter contains multiple real-world examples, including detailed case studies and previously unpublished details of the infrastructure used to power Google's online services. Targeted at the architects and programmers of today's WSCs, this book provides a great foundation for those looking to innovate in this fascinating and important area, but the material will also be broadly interesting to those who just want to understand the infrastructure powering the internet. The third edition reflects four years of advancements since the previous edition and nearly doubles the number of pictures and figures. New topics range from additional workloads like video streaming, machine learning, and public cloud to specialized silicon accelerators, storage and network building blocks, and a revised discussion of data center power and cooling, and uptime. Further discussions of emerging trends and opportunities ensure that this revised edition will remain an essential resource for educators and professionals working on the next generation of WSCs.
Master the basics of data centers to build server farms that enhance your Web site performance Learn design guidelines that show how to deploy server farms in highly available and scalable environments Plan site performance capacity with discussions of server farm architectures and their real-life applications to determine your system needs Today's market demands that businesses have an Internet presence through which they can perform e-commerce and customer support, and establish a presence that can attract and increase their customer base. Underestimated hit ratios, compromised credit card records, perceived slow Web site access, or the infamous "Object Not Found" alerts make the difference between a successful online presence and one that is bound to fail. These challenges can be solved in part with the use of data center technology. Data centers switch traffic based on information at the Network, Transport, or Application layers. Content switches perform the "best server" selection process to direct users' requests for a specific service to a server in a server farm. The best server selection process takes into account both server load and availability, and the existence and consistency of the requested content. Data Center Fundamentals helps you understand the basic concepts behind the design and scaling of server farms using data center and content switching technologies. It addresses the principles and concepts needed to take on the most common challenges encountered during planning, implementing, and managing Internet and intranet IP-based server farms. An in-depth analysis of the data center technology with real-life scenarios make Data Center Fundamentals an ideal reference for understanding, planning, and designing Web hosting and e-commerce environments.
Provides the fundamentals, technologies, and best practices in designing, constructing and managing mission critical, energy efficient data centers Organizations in need of high-speed connectivity and nonstop systems operations depend upon data centers for a range of deployment solutions. A data center is a facility used to house computer systems and associated components, such as telecommunications and storage systems. It generally includes multiple power sources, redundant data communications connections, environmental controls (e.g., air conditioning, fire suppression) and security devices. With contributions from an international list of experts, The Data Center Handbook instructs readers to: Prepare strategic plan that includes location plan, site selection, roadmap and capacity planning Design and build "green" data centers, with mission critical and energy-efficient infrastructure Apply best practices to reduce energy consumption and carbon emissions Apply IT technologies such as cloud and virtualization Manage data centers in order to sustain operations with minimum costs Prepare and practice disaster reovery and business continuity plan The book imparts essential knowledge needed to implement data center design and construction, apply IT technologies, and continually improve data center operations.
Data Center Virtualization Fundamentals For many IT organizations, today''s greatest challenge is to drive more value, efficiency, and utilization from data centers. Virtualization is the best way to meet this challenge. Data Center Virtualization Fundamentals brings together the comprehensive knowledge Cisco professionals need to apply virtualization throughout their data center environments. Leading data center expert Gustavo A. A. Santana thoroughly explores all components of an end-to-end data center virtualization solution, including networking, storage, servers, operating systems, application optimization, and security. Rather than focusing on a single product or technology, he explores product capabilities as interoperable design tools that can be combined and integrated with other solutions, including VMware vSphere. With the author''s guidance, you''ll learn how to define and implement highly-efficient architectures for new, expanded, or retrofit data center projects. By doing so, you can deliver agile application provisioning without purchasing unnecessary infrastructure, and establish a strong foundation for new cloud computing and IT-as-a-service initiatives. Throughout, Santana illuminates key theoretical concepts through realistic use cases, real-world designs, illustrative configuration examples, and verification outputs. Appendixes provide valuable reference information, including relevant Cisco data center products and CLI principles for IOS and NX-OS. With this approach, Data Center Virtualization Fundamentals will be an indispensable resource for anyone preparing for the CCNA Data Center, CCNP Data Center, or CCIE Data Center certification exams. Gustavo A. A. Santana, CCIE® No. 8806, is a Cisco Technical Solutions Architect working in enterprise and service provider data center projects that require deep integration across technology areas such as networking, application optimization, storage, and servers. He has more than 15 years of data center experience, and has led and coordinated a team of specialized Cisco engineers in Brazil. He holds two CCIE certifications (Routing & Switching and Storage Networking), and is a VMware Certified Professional (VCP) and SNIA Certified Storage Networking Expert (SCSN-E). A frequent speaker at Cisco and data center industry events, he blogs on data center virtualization at gustavoaasantana.net. Learn how virtualization can transform and improve traditional data center network topologies Understand the key characteristics and value of each data center virtualization technology Walk through key decisions, and transform choices into architecture Smoothly migrate existing data centers toward greater virtualization Burst silos that have traditionally made data centers inefficient Master foundational technologies such as VLANs, VRF, and virtual contexts Use virtual PortChannel and FabricPath to overcome the limits of STP Optimize cabling and network management with fabric extender (FEX) virtualized chassis Extend Layer 2 domains to distant data center sites using MPLS and Overlay Transport Virtualization (OTV) Use VSANs to overcome Fibre Channel fabric challenges Improve SAN data protection, environment isolation, and scalability Consolidate I/O through Data Center Bridging and FCoE Use virtualization to radically simplify server environments Create server profiles that streamline "bare metal" server provisioning "Transcend the rack" through virtualized networking based on Nexus 1000V and VM-FEX Leverage opportunities to deploy virtual network services more efficiently Evolve data center virtualization toward full-fledged private clouds -Reviews - "The variety of material that Gustavo covers in this work would appeal to anyone responsible for Data Centers today. His grasp of virtualization technologies and ability to relate it in both technical and non-technical terms makes for compelling reading. This is not your ordinary tech manual. Through use of relatable visual cues, Gustavo provides information that is easily recalled on the subject of virtualization, reaching across Subject Matter Expertise domains. Whether you consider yourself well-versed or a novice on the topic, working in large or small environments, this work will provide a clear understanding of the diverse subject of virtualization." -- Bill Dufresne, CCIE 4375, Distinguished Systems Engineer, Cisco (Americas) "..this book is an essential reference and will be valuable asset for potential candidates pursuing their Cisco Data Center certifications. I am confident that in reading this book, individuals will inevitably gain extensive knowledge and hands-on experience during their certification preparations. If you''re looking for a truly comprehensive guide to virtualization, this is the one!" -- Yusuf Bhaiji, Senior Manager, Expert Certifications (CCIE, CCDE, CCAr), Learning@Cisco "When one first looks at those classic Cisco Data Center blueprints, it is very common to become distracted with the overwhelming number of pieces and linkages. By creating a solid theoretical foundation and providing rich sets of companion examples to illustrate each concept, Gustavo''s book brings hope back to IT Professionals from different areas of expertise. Apparently complex topics are demystified and the insertion of products, mechanisms, protocols and technologies in the overall Data Center Architecture is clearly explained, thus enabling you to achieve robust designs and successful deployments. A must read... Definitely!" -- Alexandre M. S. P. Moraes, Consulting Systems Engineer -- Author of "Cisco Firewalls"
ABSTRACT As computation continues to move into the cloud, the computing platform of interest no longer resembles a pizza box or a refrigerator, but a warehouse full of computers. These new large datacenters are quite different from traditional hosting facilities of earlier times and cannot be viewed simply as a collection of co-located servers. Large portions of the hardware and software resources in these facilities must work in concert to efficiently deliver good levels of Internet service performance, something that can only be achieved by a holistic approach to their design and deployment. In other words, we must treat the datacenter itself as one massive warehouse-scale computer (WSC). We describe the architecture of WSCs, the main factors influencing their design, operation, and cost structure, and the characteristics of their software base. We hope it will be useful to architects and programmers of today's WSCs, as well as those of future many-core platforms which may one day implement the equivalent of today's WSCs on a single board. NOTES FOR THE SECOND EDITION After nearly four years of substantial academic and industrial developments in warehouse-scale computing, we are delighted to present our first major update to this lecture. The increased popularity of public clouds has made WSC software techniques relevant to a larger pool of programmers since our first edition. Therefore, we expanded Chapter 2 to reflect our better understanding of WSC software systems and the toolbox of software techniques for WSC programming. In Chapter 3, we added to our coverage of the evolving landscape of wimpy vs. brawny server trade-offs, and we now present an overview of WSC interconnects and storage systems that was promised but lacking in the original edition. Thanks largely to the help of our new co-author, Google Distinguished Engineer Jimmy Clidaras, the material on facility mechanical and power distribution design has been updated and greatly extended (see Chapters 4 and 5). Chapters 6 and 7 have also been revamped significantly. We hope this revised edition continues to meet the needs of educators and professionals in this area.
An approachable, hands-on guide to understanding how computers work, from low-level circuits to high-level code. How Computers Really Work is a hands-on guide to the computing ecosystem: everything from circuits to memory and clock signals, machine code, programming languages, operating systems, and the internet. But you won't just read about these concepts, you'll test your knowledge with exercises, and practice what you learn with 41 optional hands-on projects. Build digital circuits, craft a guessing game, convert decimal numbers to binary, examine virtual memory usage, run your own web server, and more. Explore concepts like how to: Think like a software engineer as you use data to describe a real world concept Use Ohm's and Kirchhoff's laws to analyze an electrical circuit Think like a computer as you practice binary addition and execute a program in your mind, step-by-step The book's projects will have you translate your learning into action, as you: Learn how to use a multimeter to measure resistance, current, and voltage Build a half adder to see how logical operations in hardware can be combined to perform useful functions Write a program in assembly language, then examine the resulting machine code Learn to use a debugger, disassemble code, and hack a program to change its behavior without changing the source code Use a port scanner to see which internet ports your computer has open Run your own server and get a solid crash course on how the web works And since a picture is worth a thousand bytes, chapters are filled with detailed diagrams and illustrations to help clarify technical complexities. Requirements: The projects require a variety of hardware - electronics projects need a breadboard, power supply, and various circuit components; software projects are performed on a Raspberry Pi. Appendix B contains a complete list. Even if you skip the projects, the book's major concepts are clearly presented in the main text.
The new RISC-V Edition of Computer Organization and Design features the RISC-V open source instruction set architecture, the first open source architecture designed to be used in modern computing environments such as cloud computing, mobile devices, and other embedded systems. With the post-PC era now upon us, Computer Organization and Design moves forward to explore this generational change with examples, exercises, and material highlighting the emergence of mobile computing and the Cloud. Updated content featuring tablet computers, Cloud infrastructure, and the x86 (cloud computing) and ARM (mobile computing devices) architectures is included. An online companion Web site provides advanced content for further study, appendices, glossary, references, and recommended reading. - Features RISC-V, the first such architecture designed to be used in modern computing environments, such as cloud computing, mobile devices, and other embedded systems - Includes relevant examples, exercises, and material highlighting the emergence of mobile computing and the cloud
