Amazon S3 Cookbook
Amazon S3 Cookbook

Author: Naoya Hashimoto

Publisher: Packt Publishing Ltd

Published: 2015-08-27

Total Pages: 280

ISBN-13: 1785289853

DOWNLOAD EBOOK

Over 30 hands-on recipes that will get you up and running with Amazon Simple Storage Service (S3) efficiently About This Book Learn how to store, manage, and access your data with AWS SDKs Study the Amazon S3 pricing model and learn how to calculate costs by simulating practical scenarios Optimize your Amazon S3 bucket by following step-by-step instructions of how to deliver your content with CloudFront, secure the S3 bucket with IAM, and lower costs with object life cycle management Who This Book Is For This book is for cloud developers who have experience of using Amazon S3 and are also familiar with Amazon S3. What You Will Learn Host a static website on Amazon S3 Calculate costs with AWS Simple Monthly Calculators Deploy a static website via CloudFormation Distribute your content via CloudFront Secure resources with bucket policies and IAM Protect objects using server-side and client-side encryption Enable Cross-Origin Resource Sharing Manage objects' life cycles to lower costs Optimize performance for uploading as well as downloading objects Enable S3 event notifications and create Lambda functions Manage common operations with AWS SDKs In Detail Amazon S3 is one of the most famous and trailblazing cloud object storage services, which is highly scalable, low-latency, and economical. Users only pay for what they use and can store and retrieve any amount of data at any time over the Internet, which attracts Hadoop users who run clusters on EC2. The book starts by showing you how to install several AWS SDKs such as iOS, Java, Node.js, PHP, Python, and Ruby and shows you how to manage objects. Then, you'll be taught how to use the installed AWS SDKs to develop applications with Amazon S3. Furthermore, you will explore the Amazon S3 pricing model and will learn how to annotate S3 billing with cost allocation tagging. In addition to this, the book covers several practical recipes about how to distribute your content with CloudFront, secure your content with IAM, optimize Amazon S3 performance, and notify S3 events with Lambada. By the end of this book, you will be successfully implementing pro-level practices, techniques, and solutions in Amazon S3. Style and approach A step-by-step practical guide that will show you how to efficiently store, manage, and control your data in Amazon S3.

Data Engineering with AWS Cookbook
Data Engineering with AWS Cookbook

Author: Trâm Ngọc Phạm

Publisher: Packt Publishing Ltd

Published: 2024-11-29

Total Pages: 529

ISBN-13: 1805126857

DOWNLOAD EBOOK

Master AWS data engineering services and techniques for orchestrating pipelines, building layers, and managing migrations Key Features Get up to speed with the different AWS technologies for data engineering Learn the different aspects and considerations of building data lakes, such as security, storage, and operations Get hands on with key AWS services such as Glue, EMR, Redshift, QuickSight, and Athena for practical learning Purchase of the print or Kindle book includes a free PDF eBook Book DescriptionPerforming data engineering with Amazon Web Services (AWS) combines AWS's scalable infrastructure with robust data processing tools, enabling efficient data pipelines and analytics workflows. This comprehensive guide to AWS data engineering will teach you all you need to know about data lake management, pipeline orchestration, and serving layer construction. Through clear explanations and hands-on exercises, you’ll master essential AWS services such as Glue, EMR, Redshift, QuickSight, and Athena. Additionally, you’ll explore various data platform topics such as data governance, data quality, DevOps, CI/CD, planning and performing data migration, and creating Infrastructure as Code. As you progress, you will gain insights into how to enrich your platform and use various AWS cloud services such as AWS EventBridge, AWS DataZone, and AWS SCT and DMS to solve data platform challenges. Each recipe in this book is tailored to a daily challenge that a data engineer team faces while building a cloud platform. By the end of this book, you will be well-versed in AWS data engineering and have gained proficiency in key AWS services and data processing techniques. You will develop the necessary skills to tackle large-scale data challenges with confidence.What you will learn Define your centralized data lake solution, and secure and operate it at scale Identify the most suitable AWS solution for your specific needs Build data pipelines using multiple ETL technologies Discover how to handle data orchestration and governance Explore how to build a high-performing data serving layer Delve into DevOps and data quality best practices Migrate your data from on-premises to AWS Who this book is for If you're involved in designing, building, or overseeing data solutions on AWS, this book provides proven strategies for addressing challenges in large-scale data environments. Data engineers as well as big data professionals looking to enhance their understanding of AWS features for optimizing their workflow, even if they're new to the platform, will find value. Basic familiarity with AWS security (users and roles) and command shell is recommended.

AWS Cookbook
AWS Cookbook

Author: John Culkin

Publisher: "O'Reilly Media, Inc."

Published: 2021-12-02

Total Pages: 355

ISBN-13: 1492092576

DOWNLOAD EBOOK

This practical guide provides over 100 self-contained recipes to help you creatively solve issues you may encounter in your AWS cloud endeavors. If you're comfortable with rudimentary scripting and general cloud concepts, this cookbook will give you what you need to both address foundational tasks and create high-level capabilities. AWS Cookbook provides real-world examples that incorporate best practices. Each recipe includes code that you can safely execute in a sandbox AWS account to ensure that it works. From there, you can customize the code to help construct your application or fix your specific existing problem. Recipes also include a discussion that explains the approach and provides context. This cookbook takes you beyond theory, providing the nuts and bolts you need to successfully build on AWS. You'll find recipes for: Organizing multiple accounts for enterprise deployments Locking down S3 buckets Analyzing IAM roles Autoscaling a containerized service Summarizing news articles Standing up a virtual call center Creating a chatbot that can pull answers from a knowledge repository Automating security group rule monitoring, looking for rogue traffic flows And more.

AWS Security Cookbook
AWS Security Cookbook

Author: Heartin Kanikathottu

Publisher: Packt Publishing Ltd

Published: 2020-02-27

Total Pages: 434

ISBN-13: 1838827420

DOWNLOAD EBOOK

Secure your Amazon Web Services (AWS) infrastructure with permission policies, key management, and network security, along with following cloud security best practices Key Features Explore useful recipes for implementing robust cloud security solutions on AWS Monitor your AWS infrastructure and workloads using CloudWatch, CloudTrail, config, GuardDuty, and Macie Prepare for the AWS Certified Security-Specialty exam by exploring various security models and compliance offerings Book DescriptionAs a security consultant, securing your infrastructure by implementing policies and following best practices is critical. This cookbook discusses practical solutions to the most common problems related to safeguarding infrastructure, covering services and features within AWS that can help you implement security models such as the CIA triad (confidentiality, integrity, and availability), and the AAA triad (authentication, authorization, and availability), along with non-repudiation. The book begins with IAM and S3 policies and later gets you up to speed with data security, application security, monitoring, and compliance. This includes everything from using firewalls and load balancers to secure endpoints, to leveraging Cognito for managing users and authentication. Over the course of this book, you'll learn to use AWS security services such as Config for monitoring, as well as maintain compliance with GuardDuty, Macie, and Inspector. Finally, the book covers cloud security best practices and demonstrates how you can integrate additional security services such as Glacier Vault Lock and Security Hub to further strengthen your infrastructure. By the end of this book, you'll be well versed in the techniques required for securing AWS deployments, along with having the knowledge to prepare for the AWS Certified Security – Specialty certification.What you will learn Create and manage users, groups, roles, and policies across accounts Use AWS Managed Services for logging, monitoring, and auditing Check compliance with AWS Managed Services that use machine learning Provide security and availability for EC2 instances and applications Secure data using symmetric and asymmetric encryption Manage user pools and identity pools with federated login Who this book is for If you are an IT security professional, cloud security architect, or a cloud application developer working on security-related roles and are interested in using AWS infrastructure for secure application deployments, then this Amazon Web Services book is for you. You will also find this book useful if you’re looking to achieve AWS certification. Prior knowledge of AWS and cloud computing is required to get the most out of this book.

Amazon Redshift Cookbook
Amazon Redshift Cookbook

Author: Shruti Worlikar

Publisher: Packt Publishing Ltd

Published: 2021-07-23

Total Pages: 384

ISBN-13: 1800561849

DOWNLOAD EBOOK

Discover how to build a cloud-based data warehouse at petabyte-scale that is burstable and built to scale for end-to-end analytical solutions Key FeaturesDiscover how to translate familiar data warehousing concepts into Redshift implementationUse impressive Redshift features to optimize development, productionizing, and operations processesFind out how to use advanced features such as concurrency scaling, Redshift Spectrum, and federated queriesBook Description Amazon Redshift is a fully managed, petabyte-scale AWS cloud data warehousing service. It enables you to build new data warehouse workloads on AWS and migrate on-premises traditional data warehousing platforms to Redshift. This book on Amazon Redshift starts by focusing on Redshift architecture, showing you how to perform database administration tasks on Redshift. You'll then learn how to optimize your data warehouse to quickly execute complex analytic queries against very large datasets. Because of the massive amount of data involved in data warehousing, designing your database for analytical processing lets you take full advantage of Redshift's columnar architecture and managed services. As you advance, you'll discover how to deploy fully automated and highly scalable extract, transform, and load (ETL) processes, which help minimize the operational efforts that you have to invest in managing regular ETL pipelines and ensure the timely and accurate refreshing of your data warehouse. Finally, you'll gain a clear understanding of Redshift use cases, data ingestion, data management, security, and scaling so that you can build a scalable data warehouse platform. By the end of this Redshift book, you'll be able to implement a Redshift-based data analytics solution and have understood the best practice solutions to commonly faced problems. What you will learnUse Amazon Redshift to build petabyte-scale data warehouses that are agile at scaleIntegrate your data warehousing solution with a data lake using purpose-built features and services on AWSBuild end-to-end analytical solutions from data sourcing to consumption with the help of useful recipesLeverage Redshift's comprehensive security capabilities to meet the most demanding business requirementsFocus on architectural insights and rationale when using analytical recipesDiscover best practices for working with big data to operate a fully managed solutionWho this book is for This book is for anyone involved in architecting, implementing, and optimizing an Amazon Redshift data warehouse, such as data warehouse developers, data analysts, database administrators, data engineers, and data scientists. Basic knowledge of data warehousing, database systems, and cloud concepts and familiarity with Redshift will be beneficial.

Amazon S3 Essentials
Amazon S3 Essentials

Author: Sunil Gulabani

Publisher: Packt Publishing Ltd

Published: 2015-11-03

Total Pages: 112

ISBN-13: 1783554908

DOWNLOAD EBOOK

Get started with Amazon S3 for virtually unlimited cloud and Internet storage About This Book Familiarize yourself with the concepts of Amazon S3 Understand basic operations of bucket, folders, and objects using Amazon S3 SDK Java Leverage the power of Amazon S3 to effectively store and retrieve data Who This Book Is For This book is intended for System Engineers/ Developers, Software Architects, Project managers, and users who want to explore Amazon S3 SDK Java. If you want to learn about Amazon S3 quickly, then this book is for you. Basic knowledge of Java programming is expected. What You Will Learn Start with the basic concepts of Amazon S3 to get you going Use Copy Object and Multipart Copy Object for objects of different sizes Understand how to use the amazon management console for Amazon S3 Learn how to use the AWS SDK of Java and consume the Amazon S3 Get to grips with managing the bucket life cycle Configure CORS to share resources to a different domain Discover how to develop and deploy the static website on Amazon S3 using different services of Amazon In Detail Amazon Simple Storage Service (Amazon S3), provides developers and IT teams with secure, durable, and highly-scalable object storage. Amazon S3 is easy to use, with a simple web services interface to store and retrieve any amount of data from anywhere on the web. S3 is automatically web scalable and responds to the requirements of your application and traffic, and therefore offers a key element to help companies deal dynamically with any spike in traffic for their application (such as a free e-book offer). This book starts with the basics of the Amazon S3 and its features, and you will quickly get an understanding how to use the Amazon Management Console for Amazon S3 which is the simplest way to manage Amazon S3. Next, we will cover basic operations on bucket, folder, objects. Once the basic operations are understood, you will know how to use Amazon S3 using Java SDK. Following that, you will learn about Copy Objects and Multipart copy objects for large objects size. You will also learn to manage the life cycle of bucket and how to share resources to the different domain by configuring CORS. The book will then guide you through the development and deployment of a static website on Amazon S3 using different services of Amazon. By the end of the book, you will be able to create a scalable application using Amazon S3. Style and approach This fast-paced book is a pragmatic guide to writing Amazon S3 applications. Each chapter is blended beautifully with lucid concepts and pertinent examples.

Machine Learning with Amazon SageMaker Cookbook
Machine Learning with Amazon SageMaker Cookbook

Author: Joshua Arvin Lat

Publisher: Packt Publishing Ltd

Published: 2021-10-29

Total Pages: 763

ISBN-13: 1800566123

DOWNLOAD EBOOK

A step-by-step solution-based guide to preparing building, training, and deploying high-quality machine learning models with Amazon SageMaker Key FeaturesPerform ML experiments with built-in and custom algorithms in SageMakerExplore proven solutions when working with TensorFlow, PyTorch, Hugging Face Transformers, and scikit-learnUse the different features and capabilities of SageMaker to automate relevant ML processesBook Description Amazon SageMaker is a fully managed machine learning (ML) service that helps data scientists and ML practitioners manage ML experiments. In this book, you'll use the different capabilities and features of Amazon SageMaker to solve relevant data science and ML problems. This step-by-step guide features 80 proven recipes designed to give you the hands-on machine learning experience needed to contribute to real-world experiments and projects. You'll cover the algorithms and techniques that are commonly used when training and deploying NLP, time series forecasting, and computer vision models to solve ML problems. You'll explore various solutions for working with deep learning libraries and frameworks such as TensorFlow, PyTorch, and Hugging Face Transformers in Amazon SageMaker. You'll also learn how to use SageMaker Clarify, SageMaker Model Monitor, SageMaker Debugger, and SageMaker Experiments to debug, manage, and monitor multiple ML experiments and deployments. Moreover, you'll have a better understanding of how SageMaker Feature Store, Autopilot, and Pipelines can meet the specific needs of data science teams. By the end of this book, you'll be able to combine the different solutions you've learned as building blocks to solve real-world ML problems. What you will learnTrain and deploy NLP, time series forecasting, and computer vision models to solve different business problemsPush the limits of customization in SageMaker using custom container imagesUse AutoML capabilities with SageMaker Autopilot to create high-quality modelsWork with effective data analysis and preparation techniquesExplore solutions for debugging and managing ML experiments and deploymentsDeal with bias detection and ML explainability requirements using SageMaker ClarifyAutomate intermediate and complex deployments and workflows using a variety of solutionsWho this book is for This book is for developers, data scientists, and machine learning practitioners interested in using Amazon SageMaker to build, analyze, and deploy machine learning models with 80 step-by-step recipes. All you need is an AWS account to get things running. Prior knowledge of AWS, machine learning, and the Python programming language will help you to grasp the concepts covered in this book more effectively.

AWS SysOps Cookbook
AWS SysOps Cookbook

Author: Eric Z. Beard

Publisher: Packt Publishing Ltd

Published: 2019-09-27

Total Pages: 481

ISBN-13: 1838553916

DOWNLOAD EBOOK

Become an AWS SysOps administrator and explore best practices to maintain a well-architected, resilient, and secure AWS environment Key FeaturesExplore AWS Cloud functionalities through a recipe-based approachGet to grips with a variety of techniques for automating your infrastructureDiscover industry-proven best practices for architecting reliable and efficient workloadsBook Description AWS is an on-demand remote computing service providing cloud infrastructure over the internet with storage, bandwidth, and customized support for APIs. This updated second edition will help you implement these services and efficiently administer your AWS environment. You will start with the AWS fundamentals and then understand how to manage multiple accounts before setting up consolidated billing. The book will assist you in setting up reliable and fast hosting for static websites, sharing data between running instances and backing up data for compliance. By understanding how to use compute service, you will also discover how to achieve quick and consistent instance provisioning. You’ll then learn to provision storage volumes and autoscale an app server. Next, you’ll explore serverless development with AWS Lambda, and gain insights into using networking and database services such as Amazon Neptune. The later chapters will focus on management tools like AWS CloudFormation, and how to secure your cloud resources and estimate costs for your infrastructure. Finally, you’ll use the AWS well-architected framework to conduct a technology baseline review self-assessment and identify critical areas for improvement in the management and operation of your cloud-based workloads. By the end of this book, you’ll have the skills to effectively administer your AWS environment. What you will learnSecure your account by creating IAM users and avoiding the use of the root loginSimplify the creation of a multi-account landing zone using AWS Control TowerMaster Amazon S3 for unlimited, cost-efficient storage of dataExplore a variety of compute resources on the AWS Cloud, such as EC2 and AWS LambdaConfigure secure networks using Amazon VPC, access control lists, and security groupsEstimate your monthly bill by using cost estimation toolsLearn to host a website with Amazon Route 53, Amazon CloudFront, and S3Who this book is for If you are an administrator, DevOps engineer, or an IT professional interested in exploring administrative tasks on the AWS Cloud, then this book is for you. Familiarity with cloud computing platforms and some understanding of virtualization, networking, and other administration-related tasks is assumed.

Amazon EC2 Cookbook
Amazon EC2 Cookbook

Author: Sekhar Reddy

Publisher: Packt Publishing Ltd

Published: 2015-11-27

Total Pages: 195

ISBN-13: 1785282255

DOWNLOAD EBOOK

Over 40 hands-on recipes to develop and deploy real-world applications using Amazon EC2 About This Book Design and build applications using Amazon EC2 and a range of supporting AWS tools Find highly effective solutions to your AWS Cloud-based application development, deployment, and infrastructural issues A comprehensive set of recipes to implement your product's functional and non-functional requirements Who This Book Is For This book is targeted at Cloud-based developers who have prior exposure to AWS concepts and features. Some experience in building small applications and creating some proof-of-concept applications is required. What You Will Learn Select and configure the right EC2 instances Create, configure, and secure a Virtual Private Cloud Create an AWS CloudFormation template Use AWS Identity and Access Management to secure access to EC2 instances Configure auto-scaling groups using CloudWatch Choose and use the right data service such as SimpleDB and DynamoDB for your cloud applications Access key AWS services using client tools and AWS SDKs Deploy AWS applications using Docker containers In Detail Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides flexible and resizable compute capacity in the cloud. The main purpose of Amazon EC2 is to make web-scale cloud computing easier for the developers. It offers developers and companies the raw building blocks like load balancers, object stores and virtual machines running on general hardware (that is, Amazon runs a multitude of hardware components but presents them as a generic utility to its users) with accessible APIs in order to create scalable software products This book covers designing, developing, and deploying scalable, highly available, and secure applications on the AWS platform. By following the steps in the recipes, you will be able to effectively and systematically resolve issues related to development, deployment, and infrastructure for enterprise-grade cloud applications or products. This book starts with helping you choose and configure the right EC2 instances to meet your application-specific requirements. The book then moves on to creating a CloudFormation template and will teach you how to work with stacks. You will then be introduced to using IAM services to configure users, groups, roles, and multi-factor authentication. You will also learn how to connect AD to AWS IAM. Next, you will be using AWS data services and accessing other AWS services including Route 53, Amazon S3, and AWS SES (Amazon Simple Email Service). Finally, you will be deploying AWS applications using Docker containers. Style and approach This book contains a rich set of recipes that cover not only the full spectrum of real-world cloud application development using Amazon EC2, but also the services and security of the applications. The book contains easy-to-follow recipes with step-by-step instructions to leverage EC2 within your applications.

Apache Spark 2.x Cookbook
Apache Spark 2.x Cookbook

Author: Rishi Yadav

Publisher: Packt Publishing Ltd

Published: 2017-05-31

Total Pages: 288

ISBN-13: 1787127516

DOWNLOAD EBOOK

Over 70 recipes to help you use Apache Spark as your single big data computing platform and master its libraries About This Book This book contains recipes on how to use Apache Spark as a unified compute engine Cover how to connect various source systems to Apache Spark Covers various parts of machine learning including supervised/unsupervised learning & recommendation engines Who This Book Is For This book is for data engineers, data scientists, and those who want to implement Spark for real-time data processing. Anyone who is using Spark (or is planning to) will benefit from this book. The book assumes you have a basic knowledge of Scala as a programming language. What You Will Learn Install and configure Apache Spark with various cluster managers & on AWS Set up a development environment for Apache Spark including Databricks Cloud notebook Find out how to operate on data in Spark with schemas Get to grips with real-time streaming analytics using Spark Streaming & Structured Streaming Master supervised learning and unsupervised learning using MLlib Build a recommendation engine using MLlib Graph processing using GraphX and GraphFrames libraries Develop a set of common applications or project types, and solutions that solve complex big data problems In Detail While Apache Spark 1.x gained a lot of traction and adoption in the early years, Spark 2.x delivers notable improvements in the areas of API, schema awareness, Performance, Structured Streaming, and simplifying building blocks to build better, faster, smarter, and more accessible big data applications. This book uncovers all these features in the form of structured recipes to analyze and mature large and complex sets of data. Starting with installing and configuring Apache Spark with various cluster managers, you will learn to set up development environments. Further on, you will be introduced to working with RDDs, DataFrames and Datasets to operate on schema aware data, and real-time streaming with various sources such as Twitter Stream and Apache Kafka. You will also work through recipes on machine learning, including supervised learning, unsupervised learning & recommendation engines in Spark. Last but not least, the final few chapters delve deeper into the concepts of graph processing using GraphX, securing your implementations, cluster optimization, and troubleshooting. Style and approach This book is packed with intuitive recipes supported with line-by-line explanations to help you understand Spark 2.x's real-time processing capabilities and deploy scalable big data solutions. This is a valuable resource for data scientists and those working on large-scale data projects.