Scaling Python with Ray

Scaling Python with Ray

Author: Holden Karau

Publisher: "O'Reilly Media, Inc."

Published: 2022-11-29

Total Pages: 245

ISBN-13: 1098118766

DOWNLOAD EBOOK

Serverless computing enables developers to concentrate solely on their applications rather than worry about where they've been deployed. With the Ray general-purpose serverless implementation in Python, programmers and data scientists can hide servers, implement stateful applications, support direct communication between tasks, and access hardware accelerators. In this book, experienced software architecture practitioners Holden Karau and Boris Lublinsky show you how to scale existing Python applications and pipelines, allowing you to stay in the Python ecosystem while reducing single points of failure and manual scheduling. Scaling Python with Ray is ideal for software architects and developers eager to explore successful case studies and learn more about decision and measurement effectiveness. If your data processing or server application has grown beyond what a single computer can handle, this book is for you. You'll explore distributed processing (the pure Python implementation of serverless) and learn how to: Implement stateful applications with Ray actors Build workflow management in Ray Use Ray as a unified system for batch and stream processing Apply advanced data processing with Ray Build microservices with Ray Implement reliable Ray applications


Scaling Python with Dask

Scaling Python with Dask

Author: Holden Karau

Publisher: "O'Reilly Media, Inc."

Published: 2023-07-19

Total Pages: 226

ISBN-13: 1098119843

DOWNLOAD EBOOK

Modern systems contain multi-core CPUs and GPUs that have the potential for parallel computing. But many scientific Python tools were not designed to leverage this parallelism. With this short but thorough resource, data scientists and Python programmers will learn how the Dask open source library for parallel computing provides APIs that make it easy to parallelize PyData libraries including NumPy, pandas, and scikit-learn. Authors Holden Karau and Mika Kimmins show you how to use Dask computations in local systems and then scale to the cloud for heavier workloads. This practical book explains why Dask is popular among industry experts and academics and is used by organizations that include Walmart, Capital One, Harvard Medical School, and NASA. With this book, you'll learn: What Dask is, where you can use it, and how it compares with other tools How to use Dask for batch data parallel processing Key distributed system concepts for working with Dask Methods for using Dask with higher-level APIs and building blocks How to work with integrated libraries such as scikit-learn, pandas, and PyTorch How to use Dask with GPUs


Python Playground, 2nd Edition

Python Playground, 2nd Edition

Author: Mahesh Venkitachalam

Publisher: No Starch Press

Published: 2023-11-28

Total Pages: 447

ISBN-13: 1718503059

DOWNLOAD EBOOK

Put the fun back in Python programming and build your skills as you create 3D simulations and graphics, speech-recognition machine-learning systems, IoT devices, and more. The fully updated 2nd edition is here, now with 5 brand-new projects! Harness the power of Python as you turn code into tangible creations with Python Playground, a collection of 15 inventive projects that will expand your programming horizons, spark your curiosity, and elevate your coding skills. Go beyond the basics as you write programs to generate art and music, simulate real-world phenomena, and interact with hardware, all through the use of Python and common libraries such as numpy, matplotlib, and Pillow. As you work through the book’s projects, you will: Craft intricate Spirograph-like designs with parametric equations and the turtle module Generate music by synthesizing plucked string sounds Transform everyday images into ASCII art, photomosaics, and eye-popping autostereograms Design engaging cellular automata and flocking simulations Explore the realm of 3D graphics, from basic shape rendering to visualizing MRI scan data Build a Raspberry Pi–powered laser show that dances along with music New to this edition: We’ve expanded your playground with five new projects: you’ll draw fractals, bring Conway’s Game of Life into 3D space, and use a Raspberry Pi and Python to create a musical instrument, an IoT garden monitor, and even a machine learning–driven speech recognition system. Whether you’re a seasoned professional or just getting started, you’ll find Python Playground to be a great way to learn, experiment with, and master this versatile programming language. Covers Python 3.x


Machine Learning Engineering with Python

Machine Learning Engineering with Python

Author: Andrew P. McMahon

Publisher: Packt Publishing Ltd

Published: 2023-08-31

Total Pages: 463

ISBN-13: 1837634351

DOWNLOAD EBOOK

Transform your machine learning projects into successful deployments with this practical guide on how to build and scale solutions that solve real-world problems Includes a new chapter on generative AI and large language models (LLMs) and building a pipeline that leverages LLMs using LangChain Key Features This second edition delves deeper into key machine learning topics, CI/CD, and system design Explore core MLOps practices, such as model management and performance monitoring Build end-to-end examples of deployable ML microservices and pipelines using AWS and open-source tools Book DescriptionThe Second Edition of Machine Learning Engineering with Python is the practical guide that MLOps and ML engineers need to build solutions to real-world problems. It will provide you with the skills you need to stay ahead in this rapidly evolving field. The book takes an examples-based approach to help you develop your skills and covers the technical concepts, implementation patterns, and development methodologies you need. You'll explore the key steps of the ML development lifecycle and create your own standardized "model factory" for training and retraining of models. You'll learn to employ concepts like CI/CD and how to detect different types of drift. Get hands-on with the latest in deployment architectures and discover methods for scaling up your solutions. This edition goes deeper in all aspects of ML engineering and MLOps, with emphasis on the latest open-source and cloud-based technologies. This includes a completely revamped approach to advanced pipelining and orchestration techniques. With a new chapter on deep learning, generative AI, and LLMOps, you will learn to use tools like LangChain, PyTorch, and Hugging Face to leverage LLMs for supercharged analysis. You will explore AI assistants like GitHub Copilot to become more productive, then dive deep into the engineering considerations of working with deep learning.What you will learn Plan and manage end-to-end ML development projects Explore deep learning, LLMs, and LLMOps to leverage generative AI Use Python to package your ML tools and scale up your solutions Get to grips with Apache Spark, Kubernetes, and Ray Build and run ML pipelines with Apache Airflow, ZenML, and Kubeflow Detect drift and build retraining mechanisms into your solutions Improve error handling with control flows and vulnerability scanning Host and build ML microservices and batch processes running on AWS Who this book is for This book is designed for MLOps and ML engineers, data scientists, and software developers who want to build robust solutions that use machine learning to solve real-world problems. If you’re not a developer but want to manage or understand the product lifecycle of these systems, you’ll also find this book useful. It assumes a basic knowledge of machine learning concepts and intermediate programming experience in Python. With its focus on practical skills and real-world examples, this book is an essential resource for anyone looking to advance their machine learning engineering career.


Automated Technology for Verification and Analysis

Automated Technology for Verification and Analysis

Author: Étienne André

Publisher: Springer Nature

Published: 2023-10-21

Total Pages: 453

ISBN-13: 3031453298

DOWNLOAD EBOOK

This book constitutes the refereed proceedings of the 21st International Symposium on Automated Technology for Verification and Analysis, ATVA 2023, held in Singapore, in October 2023. The symposium intends to promote research in theoretical and practical aspects of automated analysis, verification and synthesis by providing a forum for interaction between regional and international research communities and industry in related areas. The 30 regular papers presented together with 7 tool papers were carefully reviewed and selected from 150 submissions.The papers are divided into the following topical sub-headings: Temporal logics, Data structures and heuristics, Verification of programs and hardware.


High Performance Computing

High Performance Computing

Author: Amanda Bienz

Publisher: Springer Nature

Published: 2023-09-25

Total Pages: 677

ISBN-13: 3031408438

DOWNLOAD EBOOK

This volume constitutes the papers of several workshops which were held in conjunction with the 38th International Conference on High Performance Computing, ISC High Performance 2023, held in Hamburg, Germany, during May 21–25, 2023. The 49 revised full papers presented in this book were carefully reviewed and selected from 70 submissions. ISC High Performance 2023 presents the following workshops: ​2nd International Workshop on Malleability Techniques Applications in High-Performance Computing (HPCMALL) 18th Workshop on Virtualization in High-Performance Cloud Computing (VHPC 23) HPC I/O in the Data Center (HPC IODC) Workshop on Converged Computing of Cloud, HPC, and Edge (WOCC’23) 7th International Workshop on In Situ Visualization (WOIV’23) Workshop on Monitoring and Operational Data Analytics (MODA23) 2nd Workshop on Communication, I/O, and Storage at Scale on Next-Generation Platforms: Scalable Infrastructures First International Workshop on RISC-V for HPC Second Combined Workshop on Interactive and Urgent Supercomputing (CWIUS) HPC on Heterogeneous Hardware (H3)


Python Playground

Python Playground

Author: Mahesh Venkitachalam

Publisher: No Starch Press

Published: 2015-10-01

Total Pages: 353

ISBN-13: 1593277334

DOWNLOAD EBOOK

Python is a powerful programming language that’s easy to learn and fun to play with. But once you’ve gotten a handle on the basics, what do you do next? Python Playground is a collection of imaginative programming projects that will inspire you to use Python to make art and music, build simulations of real-world phenomena, and interact with hardware like the Arduino and Raspberry Pi. You’ll learn to use common Python tools and libraries like numpy, matplotlib, and pygame to do things like: –Generate Spirograph-like patterns using parametric equations and the turtle module –Create music on your computer by simulating frequency overtones –Translate graphical images into ASCII art –Write an autostereogram program that produces 3D images hidden beneath random patterns –Make realistic animations with OpenGL shaders by exploring particle systems, transparency, and billboarding techniques –Construct 3D visualizations using data from CT and MRI scans –Build a laser show that responds to music by hooking up your computer to an Arduino Programming shouldn’t be a chore. Have some solid, geeky fun with Python Playground. The projects in this book are compatible with both Python 2 and 3.


Generative AI with LangChain

Generative AI with LangChain

Author: Ben Auffarth

Publisher: Packt Publishing Ltd

Published: 2023-12-22

Total Pages: 369

ISBN-13: 1835088368

DOWNLOAD EBOOK

2024 Edition – Get to grips with the LangChain framework to develop production-ready applications, including agents and personal assistants. The 2024 edition features updated code examples and an improved GitHub repository. Purchase of the print or Kindle book includes a free PDF eBook. Key Features Learn how to leverage LangChain to work around LLMs’ inherent weaknesses Delve into LLMs with LangChain and explore their fundamentals, ethical dimensions, and application challenges Get better at using ChatGPT and GPT models, from heuristics and training to scalable deployment, empowering you to transform ideas into reality Book DescriptionChatGPT and the GPT models by OpenAI have brought about a revolution not only in how we write and research but also in how we can process information. This book discusses the functioning, capabilities, and limitations of LLMs underlying chat systems, including ChatGPT and Gemini. It demonstrates, in a series of practical examples, how to use the LangChain framework to build production-ready and responsive LLM applications for tasks ranging from customer support to software development assistance and data analysis – illustrating the expansive utility of LLMs in real-world applications. Unlock the full potential of LLMs within your projects as you navigate through guidance on fine-tuning, prompt engineering, and best practices for deployment and monitoring in production environments. Whether you're building creative writing tools, developing sophisticated chatbots, or crafting cutting-edge software development aids, this book will be your roadmap to mastering the transformative power of generative AI with confidence and creativity.What you will learn Create LLM apps with LangChain, like question-answering systems and chatbots Understand transformer models and attention mechanisms Automate data analysis and visualization using pandas and Python Grasp prompt engineering to improve performance Fine-tune LLMs and get to know the tools to unleash their power Deploy LLMs as a service with LangChain and apply evaluation strategies Privately interact with documents using open-source LLMs to prevent data leaks Who this book is for The book is for developers, researchers, and anyone interested in learning more about LangChain. Whether you are a beginner or an experienced developer, this book will serve as a valuable resource if you want to get the most out of LLMs using LangChain. Basic knowledge of Python is a prerequisite, while prior exposure to machine learning will help you follow along more easily.