Practical Machine Learning on Databricks

Practical Machine Learning on Databricks

Author: Debu Sinha

Publisher: Packt Publishing Ltd

Published: 2023-11-24

Total Pages: 244

ISBN-13: 1801818290

DOWNLOAD EBOOK

Take your machine learning skills to the next level by mastering databricks and building robust ML pipeline solutions for future ML innovations Key Features Learn to build robust ML pipeline solutions for databricks transition Master commonly available features like AutoML and MLflow Leverage data governance and model deployment using MLflow model registry Purchase of the print or Kindle book includes a free PDF eBook Book DescriptionUnleash the potential of databricks for end-to-end machine learning with this comprehensive guide, tailored for experienced data scientists and developers transitioning from DIY or other cloud platforms. Building on a strong foundation in Python, Practical Machine Learning on Databricks serves as your roadmap from development to production, covering all intermediary steps using the databricks platform. You’ll start with an overview of machine learning applications, databricks platform features, and MLflow. Next, you’ll dive into data preparation, model selection, and training essentials and discover the power of databricks feature store for precomputing feature tables. You’ll also learn to kickstart your projects using databricks AutoML and automate retraining and deployment through databricks workflows. By the end of this book, you’ll have mastered MLflow for experiment tracking, collaboration, and advanced use cases like model interpretability and governance. The book is enriched with hands-on example code at every step. While primarily focused on generally available features, the book equips you to easily adapt to future innovations in machine learning, databricks, and MLflow.What you will learn Transition smoothly from DIY setups to databricks Master AutoML for quick ML experiment setup Automate model retraining and deployment Leverage databricks feature store for data prep Use MLflow for effective experiment tracking Gain practical insights for scalable ML solutions Find out how to handle model drifts in production environments Who this book is forThis book is for experienced data scientists, engineers, and developers proficient in Python, statistics, and ML lifecycle looking to transition to databricks from DIY clouds. Introductory Spark knowledge is a must to make the most out of this book, however, end-to-end ML workflows will be covered. If you aim to accelerate your machine learning workflows and deploy scalable, robust solutions, this book is an indispensable resource.


Building the Data Lakehouse

Building the Data Lakehouse

Author: Bill Inmon

Publisher: Technics Publications

Published: 2021-10

Total Pages: 256

ISBN-13: 9781634629669

DOWNLOAD EBOOK

The data lakehouse is the next generation of the data warehouse and data lake, designed to meet today's complex and ever-changing analytics, machine learning, and data science requirements. Learn about the features and architecture of the data lakehouse, along with its powerful analytical infrastructure. Appreciate how the universal common connector blends structured, textual, analog, and IoT data. Maintain the lakehouse for future generations through Data Lakehouse Housekeeping and Data Future-proofing. Know how to incorporate the lakehouse into an existing data governance strategy. Incorporate data catalogs, data lineage tools, and open source software into your architecture to ensure your data scientists, analysts, and end users live happily ever after.


Practical Automated Machine Learning on Azure

Practical Automated Machine Learning on Azure

Author: Deepak Mukunthu

Publisher: "O'Reilly Media, Inc."

Published: 2019-09-23

Total Pages: 190

ISBN-13: 1492055549

DOWNLOAD EBOOK

Develop smart applications without spending days and weeks building machine-learning models. With this practical book, you’ll learn how to apply automated machine learning (AutoML), a process that uses machine learning to help people build machine learning models. Deepak Mukunthu, Parashar Shah, and Wee Hyong Tok provide a mix of technical depth, hands-on examples, and case studies that show how customers are solving real-world problems with this technology. Building machine-learning models is an iterative and time-consuming process. Even those who know how to create ML models may be limited in how much they can explore. Once you complete this book, you’ll understand how to apply AutoML to your data right away. Learn how companies in different industries are benefiting from AutoML Get started with AutoML using Azure Explore aspects such as algorithm selection, auto featurization, and hyperparameter tuning Understand how data analysts, BI professions, developers can use AutoML in their familiar tools and experiences Learn how to get started using AutoML for use cases including classification, regression, and forecasting.


Spark: The Definitive Guide

Spark: The Definitive Guide

Author: Bill Chambers

Publisher: "O'Reilly Media, Inc."

Published: 2018-02-08

Total Pages: 594

ISBN-13: 1491912294

DOWNLOAD EBOOK

Learn how to use, deploy, and maintain Apache Spark with this comprehensive guide, written by the creators of the open-source cluster-computing framework. With an emphasis on improvements and new features in Spark 2.0, authors Bill Chambers and Matei Zaharia break down Spark topics into distinct sections, each with unique goals. Youâ??ll explore the basic operations and common functions of Sparkâ??s structured APIs, as well as Structured Streaming, a new high-level API for building end-to-end streaming applications. Developers and system administrators will learn the fundamentals of monitoring, tuning, and debugging Spark, and explore machine learning techniques and scenarios for employing MLlib, Sparkâ??s scalable machine-learning library. Get a gentle overview of big data and Spark Learn about DataFrames, SQL, and Datasetsâ??Sparkâ??s core APIsâ??through worked examples Dive into Sparkâ??s low-level APIs, RDDs, and execution of SQL and DataFrames Understand how Spark runs on a cluster Debug, monitor, and tune Spark clusters and applications Learn the power of Structured Streaming, Sparkâ??s stream-processing engine Learn how you can apply MLlib to a variety of problems, including classification or recommendation


Pragmatic AI

Pragmatic AI

Author: Noah Gift

Publisher: Addison-Wesley Professional

Published: 2018-07-12

Total Pages: 720

ISBN-13: 0134863917

DOWNLOAD EBOOK

Master Powerful Off-the-Shelf Business Solutions for AI and Machine Learning Pragmatic AI will help you solve real-world problems with contemporary machine learning, artificial intelligence, and cloud computing tools. Noah Gift demystifies all the concepts and tools you need to get results—even if you don’t have a strong background in math or data science. Gift illuminates powerful off-the-shelf cloud offerings from Amazon, Google, and Microsoft, and demonstrates proven techniques using the Python data science ecosystem. His workflows and examples help you streamline and simplify every step, from deployment to production, and build exceptionally scalable solutions. As you learn how machine language (ML) solutions work, you’ll gain a more intuitive understanding of what you can achieve with them and how to maximize their value. Building on these fundamentals, you’ll walk step-by-step through building cloud-based AI/ML applications to address realistic issues in sports marketing, project management, product pricing, real estate, and beyond. Whether you’re a business professional, decision-maker, student, or programmer, Gift’s expert guidance and wide-ranging case studies will prepare you to solve data science problems in virtually any environment. Get and configure all the tools you’ll need Quickly review all the Python you need to start building machine learning applications Master the AI and ML toolchain and project lifecycle Work with Python data science tools such as IPython, Pandas, Numpy, Juypter Notebook, and Sklearn Incorporate a pragmatic feedback loop that continually improves the efficiency of your workflows and systems Develop cloud AI solutions with Google Cloud Platform, including TPU, Colaboratory, and Datalab services Define Amazon Web Services cloud AI workflows, including spot instances, code pipelines, boto, and more Work with Microsoft Azure AI APIs Walk through building six real-world AI applications, from start to finish Register your book for convenient access to downloads, updates, and/or corrections as they become available. See inside book for details.


Machine Learning Using R

Machine Learning Using R

Author: Karthik Ramasubramanian

Publisher: Apress

Published: 2016-12-22

Total Pages: 580

ISBN-13: 1484223349

DOWNLOAD EBOOK

Examine the latest technological advancements in building a scalable machine learning model with Big Data using R. This book shows you how to work with a machine learning algorithm and use it to build a ML model from raw data. All practical demonstrations will be explored in R, a powerful programming language and software environment for statistical computing and graphics. The various packages and methods available in R will be used to explain the topics. For every machine learning algorithm covered in this book, a 3-D approach of theory, case-study and practice will be given. And where appropriate, the mathematics will be explained through visualization in R. All the images are available in color and hi-res as part of the code download. This new paradigm of teaching machine learning will bring about a radical change in perception for many of those who think this subject is difficult to learn. Though theory sometimes looks difficult, especially when there is heavy mathematics involved, the seamless flow from the theoretical aspects to example-driven learning provided in this book makes it easy for someone to connect the dots.. What You'll Learn Use the model building process flow Apply theoretical aspects of machine learning Review industry-based cae studies Understand ML algorithms using R Build machine learning models using Apache Hadoop and Spark Who This Book is For Data scientists, data science professionals and researchers in academia who want to understand the nuances of machine learning approaches/algorithms along with ways to see them in practice using R. The book will also benefit the readers who want to understand the technology behind implementing a scalable machine learning model using Apache Hadoop, Hive, Pig and Spark.


Practical Deep Learning at Scale with MLflow

Practical Deep Learning at Scale with MLflow

Author: Yong Liu

Publisher: Packt Publishing Ltd

Published: 2022-07-08

Total Pages: 288

ISBN-13: 1803242221

DOWNLOAD EBOOK

Train, test, run, track, store, tune, deploy, and explain provenance-aware deep learning models and pipelines at scale with reproducibility using MLflow Key Features • Focus on deep learning models and MLflow to develop practical business AI solutions at scale • Ship deep learning pipelines from experimentation to production with provenance tracking • Learn to train, run, tune and deploy deep learning pipelines with explainability and reproducibility Book Description The book starts with an overview of the deep learning (DL) life cycle and the emerging Machine Learning Ops (MLOps) field, providing a clear picture of the four pillars of deep learning: data, model, code, and explainability and the role of MLflow in these areas. From there onward, it guides you step by step in understanding the concept of MLflow experiments and usage patterns, using MLflow as a unified framework to track DL data, code and pipelines, models, parameters, and metrics at scale. You'll also tackle running DL pipelines in a distributed execution environment with reproducibility and provenance tracking, and tuning DL models through hyperparameter optimization (HPO) with Ray Tune, Optuna, and HyperBand. As you progress, you'll learn how to build a multi-step DL inference pipeline with preprocessing and postprocessing steps, deploy a DL inference pipeline for production using Ray Serve and AWS SageMaker, and finally create a DL explanation as a service (EaaS) using the popular Shapley Additive Explanations (SHAP) toolbox. By the end of this book, you'll have built the foundation and gained the hands-on experience you need to develop a DL pipeline solution from initial offline experimentation to final deployment and production, all within a reproducible and open source framework. What you will learn • Understand MLOps and deep learning life cycle development • Track deep learning models, code, data, parameters, and metrics • Build, deploy, and run deep learning model pipelines anywhere • Run hyperparameter optimization at scale to tune deep learning models • Build production-grade multi-step deep learning inference pipelines • Implement scalable deep learning explainability as a service • Deploy deep learning batch and streaming inference services • Ship practical NLP solutions from experimentation to production Who this book is for This book is for machine learning practitioners including data scientists, data engineers, ML engineers, and scientists who want to build scalable full life cycle deep learning pipelines with reproducibility and provenance tracking using MLflow. A basic understanding of data science and machine learning is necessary to grasp the concepts presented in this book.


Practical Machine Learning with Spark

Practical Machine Learning with Spark

Author: Gourav Gupta

Publisher: BPB Publications

Published: 2022-04-28

Total Pages: 501

ISBN-13: 9391392083

DOWNLOAD EBOOK

Explore the cosmic secrets of Distributed Processing for Deep Learning applications KEY FEATURES ● In-depth practical demonstration of ML/DL concepts using Distributed Framework. ● Covers graphical illustrations and visual explanations for ML/DL pipelines. ● Includes live codebase for each of NLP, computer vision and machine learning applications. DESCRIPTION This book provides the reader with an up-to-date explanation of Machine Learning and an in-depth, comprehensive, and straightforward understanding of the architectural techniques used to evaluate and anticipate the futuristic insights of data using Apache Spark. The book walks readers by setting up Hadoop and Spark installations on-premises, Docker, and AWS. Readers will learn about Spark MLib and how to utilize it in supervised and unsupervised machine learning scenarios. With the help of Spark, some of the most prominent technologies, such as natural language processing and computer vision, are evaluated and demonstrated in a realistic setting. Using the capabilities of Apache Spark, this book discusses the fundamental components that underlie each of these natural language processing, computer vision, and machine learning technologies, as well as how you can incorporate these technologies into your business processes. Towards the end of the book, readers will learn about several deep learning frameworks, such as TensorFlow and PyTorch. Readers will also learn to execute distributed processing of deep learning problems using the Spark programming language WHAT YOU WILL LEARN ●Learn how to get started with machine learning projects using Spark. ● Witness how to use Spark MLib's design for machine learning and deep learning operations. ● Use Spark in tasks involving NLP, unsupervised learning, and computer vision. ● Experiment with Spark in a cloud environment and with AI pipeline workflows. ● Run deep learning applications on a distributed network. WHO THIS BOOK IS FOR This book is valuable for data engineers, machine learning engineers, data scientists, data architects, business analysts, and technical consultants worldwide. It would be beneficial to have some familiarity with the fundamentals of Hadoop and Python. TABLE OF CONTENTS 1. Introduction to Machine Learning 2. Apache Spark Environment Setup and Configuration 3. Apache Spark 4. Apache Spark MLlib 5. Supervised Learning with Spark 6. Un-Supervised Learning with Apache Spark 7. Natural Language Processing with Apache Spark 8. Recommendation Engine with Distributed Framework 9. Deep Learning with Spark 10. Computer Vision with Apache Spark


Machine Learning Engineering with MLflow

Machine Learning Engineering with MLflow

Author: Natu Lauchande

Publisher: Packt Publishing Ltd

Published: 2021-08-27

Total Pages: 249

ISBN-13: 1800561695

DOWNLOAD EBOOK

Get up and running, and productive in no time with MLflow using the most effective machine learning engineering approach Key FeaturesExplore machine learning workflows for stating ML problems in a concise and clear manner using MLflowUse MLflow to iteratively develop a ML model and manage it Discover and work with the features available in MLflow to seamlessly take a model from the development phase to a production environmentBook Description MLflow is a platform for the machine learning life cycle that enables structured development and iteration of machine learning models and a seamless transition into scalable production environments. This book will take you through the different features of MLflow and how you can implement them in your ML project. You will begin by framing an ML problem and then transform your solution with MLflow, adding a workbench environment, training infrastructure, data management, model management, experimentation, and state-of-the-art ML deployment techniques on the cloud and premises. The book also explores techniques to scale up your workflow as well as performance monitoring techniques. As you progress, you'll discover how to create an operational dashboard to manage machine learning systems. Later, you will learn how you can use MLflow in the AutoML, anomaly detection, and deep learning context with the help of use cases. In addition to this, you will understand how to use machine learning platforms for local development as well as for cloud and managed environments. This book will also show you how to use MLflow in non-Python-based languages such as R and Java, along with covering approaches to extend MLflow with Plugins. By the end of this machine learning book, you will be able to produce and deploy reliable machine learning algorithms using MLflow in multiple environments. What you will learnDevelop your machine learning project locally with MLflow's different featuresSet up a centralized MLflow tracking server to manage multiple MLflow experimentsCreate a model life cycle with MLflow by creating custom modelsUse feature streams to log model results with MLflowDevelop the complete training pipeline infrastructure using MLflow featuresSet up an inference-based API pipeline and batch pipeline in MLflowScale large volumes of data by integrating MLflow with high-performance big data librariesWho this book is for This book is for data scientists, machine learning engineers, and data engineers who want to gain hands-on machine learning engineering experience and learn how they can manage an end-to-end machine learning life cycle with the help of MLflow. Intermediate-level knowledge of the Python programming language is expected.


Learning Spark

Learning Spark

Author: Jules S. Damji

Publisher: O'Reilly Media

Published: 2020-07-16

Total Pages: 400

ISBN-13: 1492050016

DOWNLOAD EBOOK

Data is bigger, arrives faster, and comes in a variety of formats—and it all needs to be processed at scale for analytics or machine learning. But how can you process such varied workloads efficiently? Enter Apache Spark. Updated to include Spark 3.0, this second edition shows data engineers and data scientists why structure and unification in Spark matters. Specifically, this book explains how to perform simple and complex data analytics and employ machine learning algorithms. Through step-by-step walk-throughs, code snippets, and notebooks, you’ll be able to: Learn Python, SQL, Scala, or Java high-level Structured APIs Understand Spark operations and SQL Engine Inspect, tune, and debug Spark operations with Spark configurations and Spark UI Connect to data sources: JSON, Parquet, CSV, Avro, ORC, Hive, S3, or Kafka Perform analytics on batch and streaming data using Structured Streaming Build reliable data pipelines with open source Delta Lake and Spark Develop machine learning pipelines with MLlib and productionize models using MLflow