Quick Start Guide to Large Language Models

Quick Start Guide to Large Language Models

Author: Sinan Ozdemir

Publisher: Addison-Wesley Professional

Published: 2023-09-20

Total Pages: 429

ISBN-13: 0138199337

DOWNLOAD EBOOK

The Practical, Step-by-Step Guide to Using LLMs at Scale in Projects and Products Large Language Models (LLMs) like ChatGPT are demonstrating breathtaking capabilities, but their size and complexity have deterred many practitioners from applying them. In Quick Start Guide to Large Language Models, pioneering data scientist and AI entrepreneur Sinan Ozdemir clears away those obstacles and provides a guide to working with, integrating, and deploying LLMs to solve practical problems. Ozdemir brings together all you need to get started, even if you have no direct experience with LLMs: step-by-step instructions, best practices, real-world case studies, hands-on exercises, and more. Along the way, he shares insights into LLMs' inner workings to help you optimize model choice, data formats, parameters, and performance. You'll find even more resources on the companion website, including sample datasets and code for working with open- and closed-source LLMs such as those from OpenAI (GPT-4 and ChatGPT), Google (BERT, T5, and Bard), EleutherAI (GPT-J and GPT-Neo), Cohere (the Command family), and Meta (BART and the LLaMA family). Learn key concepts: pre-training, transfer learning, fine-tuning, attention, embeddings, tokenization, and more Use APIs and Python to fine-tune and customize LLMs for your requirements Build a complete neural/semantic information retrieval system and attach to conversational LLMs for retrieval-augmented generation Master advanced prompt engineering techniques like output structuring, chain-ofthought, and semantic few-shot prompting Customize LLM embeddings to build a complete recommendation engine from scratch with user data Construct and fine-tune multimodal Transformer architectures using opensource LLMs Align LLMs using Reinforcement Learning from Human and AI Feedback (RLHF/RLAIF) Deploy prompts and custom fine-tuned LLMs to the cloud with scalability and evaluation pipelines in mind "By balancing the potential of both open- and closed-source models, Quick Start Guide to Large Language Models stands as a comprehensive guide to understanding and using LLMs, bridging the gap between theoretical concepts and practical application." --Giada Pistilli, Principal Ethicist at HuggingFace "A refreshing and inspiring resource. Jam-packed with practical guidance and clear explanations that leave you smarter about this incredible new field." --Pete Huang, author of The Neuron Register your book for convenient access to downloads, updates, and/or corrections as they become available. See inside book for details.


Natural Language Processing with Python Quick Start Guide

Natural Language Processing with Python Quick Start Guide

Author: Nirant Kasliwal

Publisher: Packt Publishing Ltd

Published: 2018-11-30

Total Pages: 177

ISBN-13: 1788994108

DOWNLOAD EBOOK

Build and deploy intelligent applications for natural language processing with Python by using industry standard tools and recently popular methods in deep learning Key FeaturesA no-math, code-driven programmer’s guide to text processing and NLPGet state of the art results with modern tooling across linguistics, text vectors and machine learningFundamentals of NLP methods from spaCy, gensim, scikit-learn and PyTorchBook Description NLP in Python is among the most sought after skills among data scientists. With code and relevant case studies, this book will show how you can use industry-grade tools to implement NLP programs capable of learning from relevant data. We will explore many modern methods ranging from spaCy to word vectors that have reinvented NLP. The book takes you from the basics of NLP to building text processing applications. We start with an introduction to the basic vocabulary along with a workflow for building NLP applications. We use industry-grade NLP tools for cleaning and pre-processing text, automatic question and answer generation using linguistics, text embedding, text classifier, and building a chatbot. With each project, you will learn a new concept of NLP. You will learn about entity recognition, part of speech tagging and dependency parsing for Q and A. We use text embedding for both clustering documents and making chatbots, and then build classifiers using scikit-learn. We conclude by deploying these models as REST APIs with Flask. By the end, you will be confident building NLP applications, and know exactly what to look for when approaching new challenges. What you will learnUnderstand classical linguistics in using English grammar for automatically generating questions and answers from a free text corpusWork with text embedding models for dense number representations of words, subwords and characters in the English language for exploring document clusteringDeep Learning in NLP using PyTorch with a code-driven introduction to PyTorchUsing an NLP project management Framework for estimating timelines and organizing your project into stagesHack and build a simple chatbot application in 30 minutesDeploy an NLP or machine learning application using Flask as RESTFUL APIsWho this book is for Programmers who wish to build systems that can interpret language. Exposure to Python programming is required. Familiarity with NLP or machine learning vocabulary will be helpful, but not mandatory.


Getting Started with Google BERT

Getting Started with Google BERT

Author: Sudharsan Ravichandiran

Publisher: Packt Publishing Ltd

Published: 2021-01-22

Total Pages: 340

ISBN-13: 1838826238

DOWNLOAD EBOOK

Kickstart your NLP journey by exploring BERT and its variants such as ALBERT, RoBERTa, DistilBERT, VideoBERT, and more with Hugging Face's transformers library Key FeaturesExplore the encoder and decoder of the transformer modelBecome well-versed with BERT along with ALBERT, RoBERTa, and DistilBERTDiscover how to pre-train and fine-tune BERT models for several NLP tasksBook Description BERT (bidirectional encoder representations from transformer) has revolutionized the world of natural language processing (NLP) with promising results. This book is an introductory guide that will help you get to grips with Google's BERT architecture. With a detailed explanation of the transformer architecture, this book will help you understand how the transformer’s encoder and decoder work. You’ll explore the BERT architecture by learning how the BERT model is pre-trained and how to use pre-trained BERT for downstream tasks by fine-tuning it for NLP tasks such as sentiment analysis and text summarization with the Hugging Face transformers library. As you advance, you’ll learn about different variants of BERT such as ALBERT, RoBERTa, and ELECTRA, and look at SpanBERT, which is used for NLP tasks like question answering. You'll also cover simpler and faster BERT variants based on knowledge distillation such as DistilBERT and TinyBERT. The book takes you through MBERT, XLM, and XLM-R in detail and then introduces you to sentence-BERT, which is used for obtaining sentence representation. Finally, you'll discover domain-specific BERT models such as BioBERT and ClinicalBERT, and discover an interesting variant called VideoBERT. By the end of this BERT book, you’ll be well-versed with using BERT and its variants for performing practical NLP tasks. What you will learnUnderstand the transformer model from the ground upFind out how BERT works and pre-train it using masked language model (MLM) and next sentence prediction (NSP) tasksGet hands-on with BERT by learning to generate contextual word and sentence embeddingsFine-tune BERT for downstream tasksGet to grips with ALBERT, RoBERTa, ELECTRA, and SpanBERT modelsGet the hang of the BERT models based on knowledge distillationUnderstand cross-lingual models such as XLM and XLM-RExplore Sentence-BERT, VideoBERT, and BARTWho this book is for This book is for NLP professionals and data scientists looking to simplify NLP tasks to enable efficient language understanding using BERT. A basic understanding of NLP concepts and deep learning is required to get the best out of this book.


Machine Learning with PyTorch and Scikit-Learn

Machine Learning with PyTorch and Scikit-Learn

Author: Sebastian Raschka

Publisher: Packt Publishing Ltd

Published: 2022-02-25

Total Pages: 775

ISBN-13: 1801816387

DOWNLOAD EBOOK

This book of the bestselling and widely acclaimed Python Machine Learning series is a comprehensive guide to machine and deep learning using PyTorch s simple to code framework. Purchase of the print or Kindle book includes a free eBook in PDF format. Key Features Learn applied machine learning with a solid foundation in theory Clear, intuitive explanations take you deep into the theory and practice of Python machine learning Fully updated and expanded to cover PyTorch, transformers, XGBoost, graph neural networks, and best practices Book DescriptionMachine Learning with PyTorch and Scikit-Learn is a comprehensive guide to machine learning and deep learning with PyTorch. It acts as both a step-by-step tutorial and a reference you'll keep coming back to as you build your machine learning systems. Packed with clear explanations, visualizations, and examples, the book covers all the essential machine learning techniques in depth. While some books teach you only to follow instructions, with this machine learning book, we teach the principles allowing you to build models and applications for yourself. Why PyTorch? PyTorch is the Pythonic way to learn machine learning, making it easier to learn and simpler to code with. This book explains the essential parts of PyTorch and how to create models using popular libraries, such as PyTorch Lightning and PyTorch Geometric. You will also learn about generative adversarial networks (GANs) for generating new data and training intelligent agents with reinforcement learning. Finally, this new edition is expanded to cover the latest trends in deep learning, including graph neural networks and large-scale transformers used for natural language processing (NLP). This PyTorch book is your companion to machine learning with Python, whether you're a Python developer new to machine learning or want to deepen your knowledge of the latest developments.What you will learn Explore frameworks, models, and techniques for machines to learn from data Use scikit-learn for machine learning and PyTorch for deep learning Train machine learning classifiers on images, text, and more Build and train neural networks, transformers, and boosting algorithms Discover best practices for evaluating and tuning models Predict continuous target outcomes using regression analysis Dig deeper into textual and social media data using sentiment analysis Who this book is for If you have a good grasp of Python basics and want to start learning about machine learning and deep learning, then this is the book for you. This is an essential resource written for developers and data scientists who want to create practical machine learning and deep learning applications using scikit-learn and PyTorch. Before you get started with this book, you’ll need a good understanding of calculus, as well as linear algebra.


Deep Learning for Coders with fastai and PyTorch

Deep Learning for Coders with fastai and PyTorch

Author: Jeremy Howard

Publisher: O'Reilly Media

Published: 2020-06-29

Total Pages: 624

ISBN-13: 1492045497

DOWNLOAD EBOOK

Deep learning is often viewed as the exclusive domain of math PhDs and big tech companies. But as this hands-on guide demonstrates, programmers comfortable with Python can achieve impressive results in deep learning with little math background, small amounts of data, and minimal code. How? With fastai, the first library to provide a consistent interface to the most frequently used deep learning applications. Authors Jeremy Howard and Sylvain Gugger, the creators of fastai, show you how to train a model on a wide range of tasks using fastai and PyTorch. You’ll also dive progressively further into deep learning theory to gain a complete understanding of the algorithms behind the scenes. Train models in computer vision, natural language processing, tabular data, and collaborative filtering Learn the latest deep learning techniques that matter most in practice Improve accuracy, speed, and reliability by understanding how deep learning models work Discover how to turn your models into web applications Implement deep learning algorithms from scratch Consider the ethical implications of your work Gain insight from the foreword by PyTorch cofounder, Soumith Chintala


Feature Engineering Bookcamp

Feature Engineering Bookcamp

Author: Sinan Ozdemir

Publisher: Simon and Schuster

Published: 2022-10-18

Total Pages: 270

ISBN-13: 1638351406

DOWNLOAD EBOOK

Deliver huge improvements to your machine learning pipelines without spending hours fine-tuning parameters! This book’s practical case-studies reveal feature engineering techniques that upgrade your data wrangling—and your ML results. In Feature Engineering Bookcamp you will learn how to: Identify and implement feature transformations for your data Build powerful machine learning pipelines with unstructured data like text and images Quantify and minimize bias in machine learning pipelines at the data level Use feature stores to build real-time feature engineering pipelines Enhance existing machine learning pipelines by manipulating the input data Use state-of-the-art deep learning models to extract hidden patterns in data Feature Engineering Bookcamp guides you through a collection of projects that give you hands-on practice with core feature engineering techniques. You’ll work with feature engineering practices that speed up the time it takes to process data and deliver real improvements in your model’s performance. This instantly-useful book skips the abstract mathematical theory and minutely-detailed formulas; instead you’ll learn through interesting code-driven case studies, including tweet classification, COVID detection, recidivism prediction, stock price movement detection, and more. About the technology Get better output from machine learning pipelines by improving your training data! Use feature engineering, a machine learning technique for designing relevant input variables based on your existing data, to simplify training and enhance model performance. While fine-tuning hyperparameters or tweaking models may give you a minor performance bump, feature engineering delivers dramatic improvements by transforming your data pipeline. About the book Feature Engineering Bookcamp walks you through six hands-on projects where you’ll learn to upgrade your training data using feature engineering. Each chapter explores a new code-driven case study, taken from real-world industries like finance and healthcare. You’ll practice cleaning and transforming data, mitigating bias, and more. The book is full of performance-enhancing tips for all major ML subdomains—from natural language processing to time-series analysis. What's inside Identify and implement feature transformations Build machine learning pipelines with unstructured data Quantify and minimize bias in ML pipelines Use feature stores to build real-time feature engineering pipelines Enhance existing pipelines by manipulating input data About the reader For experienced machine learning engineers familiar with Python. About the author Sinan Ozdemir is the founder and CTO of Shiba, a former lecturer of Data Science at Johns Hopkins University, and the author of multiple textbooks on data science and machine learning. Table of Contents 1 Introduction to feature engineering 2 The basics of feature engineering 3 Healthcare: Diagnosing COVID-19 4 Bias and fairness: Modeling recidivism 5 Natural language processing: Classifying social media sentiment 6 Computer vision: Object recognition 7 Time series analysis: Day trading with machine learning 8 Feature stores 9 Putting it all together


Artificial Intelligence Business

Artificial Intelligence Business

Author: Przemek Chojecki

Publisher: Przemek Chojecki

Published: 2020-07-15

Total Pages: 200

ISBN-13:

DOWNLOAD EBOOK

** The concise guide to Artificial Intelligence for business people and commercially oriented data scientists ** We’re living through a revolution. Artificial Intelligence is changing how we operate in the world and how smooth certain processes are. Just think about going on holidays. Multiple services allow you to find the most convenient flights and best hotels, you get personalized suggestions on what you might want to see, you go to the airport via one of the ride-sharing apps. At each of these steps, some AI algorithms are at work for your convenience. With this book, you'll learn everything from what is Artificial Intelligence, to how AI influences our economy and society. We'll talk through trends in Machine Learning and commercial applications of Artificial Intelligence. Table of Contents: Introduction Why Artificial Intelligence Practical AI and how it is done Powering Enterprises with AI Boosting Startups with Artificial Intelligence One person enhanced with AI Trends in Artificial Intelligence AI in retail Manufacturing Logistics Robotics and Autonomous Vehicles Robotic Process Automation Image generation Text generation and Chatbots AI-powered education AI in Healthcare Cybersecurity powered by AI Climate Change Games and Reinforcement Learning Hardware and beyond Machine Learning Trends AI, Politics and Society Future of Artificial Intelligence


Natural Language Processing with Transformers, Revised Edition

Natural Language Processing with Transformers, Revised Edition

Author: Lewis Tunstall

Publisher: "O'Reilly Media, Inc."

Published: 2022-05-26

Total Pages: 409

ISBN-13: 1098136764

DOWNLOAD EBOOK

Since their introduction in 2017, transformers have quickly become the dominant architecture for achieving state-of-the-art results on a variety of natural language processing tasks. If you're a data scientist or coder, this practical book -now revised in full color- shows you how to train and scale these large models using Hugging Face Transformers, a Python-based deep learning library. Transformers have been used to write realistic news stories, improve Google Search queries, and even create chatbots that tell corny jokes. In this guide, authors Lewis Tunstall, Leandro von Werra, and Thomas Wolf, among the creators of Hugging Face Transformers, use a hands-on approach to teach you how transformers work and how to integrate them in your applications. You'll quickly learn a variety of tasks they can help you solve. Build, debug, and optimize transformer models for core NLP tasks, such as text classification, named entity recognition, and question answering Learn how transformers can be used for cross-lingual transfer learning Apply transformers in real-world scenarios where labeled data is scarce Make transformer models efficient for deployment using techniques such as distillation, pruning, and quantization Train transformers from scratch and learn how to scale to multiple GPUs and distributed environments


Getting Started with Streamlit for Data Science

Getting Started with Streamlit for Data Science

Author: Tyler Richards

Publisher: Packt Publishing Ltd

Published: 2021-08-20

Total Pages: 282

ISBN-13: 1800563205

DOWNLOAD EBOOK

Create, deploy, and test your Python applications, analyses, and models with ease using Streamlit Key Features Learn how to showcase machine learning models in a Streamlit application effectively and efficiently Become an expert Streamlit creator by getting hands-on with complex application creation Discover how Streamlit enables you to create and deploy apps effortlessly Book DescriptionStreamlit shortens the development time for the creation of data-focused web applications, allowing data scientists to create web app prototypes using Python in hours instead of days. Getting Started with Streamlit for Data Science takes a hands-on approach to helping you learn the tips and tricks that will have you up and running with Streamlit in no time. You'll start with the fundamentals of Streamlit by creating a basic app and gradually build on the foundation by producing high-quality graphics with data visualization and testing machine learning models. As you advance through the chapters, you’ll walk through practical examples of both personal data projects and work-related data-focused web applications, and get to grips with more challenging topics such as using Streamlit Components, beautifying your apps, and quick deployment of your new apps. By the end of this book, you’ll be able to create dynamic web apps in Streamlit quickly and effortlessly using the power of Python.What you will learn Set up your first development environment and create a basic Streamlit app from scratch Explore methods for uploading, downloading, and manipulating data in Streamlit apps Create dynamic visualizations in Streamlit using built-in and imported Python libraries Discover strategies for creating and deploying machine learning models in Streamlit Use Streamlit sharing for one-click deployment Beautify Streamlit apps using themes, Streamlit Components, and Streamlit sidebar Implement best practices for prototyping your data science work with Streamlit Who this book is for This book is for data scientists and machine learning enthusiasts who want to create web apps using Streamlit. Whether you’re a junior data scientist looking to deploy your first machine learning project in Python to improve your resume or a senior data scientist who wants to use Streamlit to make convincing and dynamic data analyses, this book will help you get there! Prior knowledge of Python programming will assist with understanding the concepts covered.