Practical MLOps

Preface
Why We Wrote This Book
How This Book Is Organized
Chapters
Appendixes
Exercise Questions
Discussion Questions
Origin of Chapter Quotes
Conventions Used in This Book
Using Code Examples
O’Reilly Online Learning
How to Contact Us
Acknowledgments
From Noah
From Alfredo

1. Introduction to MLOps
Rise of the Machine Learning Engineer and MLOps
What Is MLOps?
DevOps and MLOps
An MLOps Hierarchy of Needs
Implementing DevOps
Configuring Continuous Integration with GitHub Actions
DataOps and Data Engineering
Platform Automation
MLOps
Conclusion
Exercises
Critical Thinking Discussion Questions

2. MLOps Foundations
Bash and the Linux Command Line
Cloud Shell Development Environments
Bash Shell and Commands
List Files
Run Commands
Files and Navigation
Input/Output
Configuration
Writing a Script
Cloud Computing Foundations and Building Blocks
Getting Started with Cloud Computing
Python Crash Course
Minimalistic Python Tutorial
Math for Programmers Crash Course
Descriptive Statistics and Normal Distributions
Optimization
Machine Learning Key Concepts
Doing Data Science
Build an MLOps Pipeline from Zero
Conclusion
Exercises
Critical Thinking Discussion Questions

3. MLOps for Containers and Edge Devices
Containers
Container Runtime
Creating a Container
Running a Container
Best Practices
Serving a Trained Model Over HTTP
Edge Devices
Coral
Azure Percept
TFHub
Porting Over Non-TPU Models
Containers for Managed ML Systems
Containers in Monetizing MLOps
Build Once, Run Many MLOps Workflow
Conclusion
Exercises
Critical Thinking Discussion Questions

4. Continuous Delivery for Machine Learning Models
Packaging for ML Models
Infrastructure as Code for Continuous Delivery of ML Models
Using Cloud Pipelines
Controlled Rollout of Models
Testing Techniques for Model Deployment
Conclusion
Exercises
Critical Thinking Discussion Questions

5. AutoML and KaizenML
AutoML
MLOps Industrial Revolution
Kaizen Versus KaizenML
Feature Stores
Apple’s Ecosystem
Apple’s AutoML: Create ML
Apple’s Core ML Tools
Google’s AutoML and Edge Computer Vision
Azure’s AutoML
AWS AutoML
Open Source AutoML Solutions
Ludwig
FLAML
Model Explainability
Conclusion
Exercises
Critical Thinking Discussion Questions

6. Monitoring and Logging
Observability for Cloud MLOps
Introduction to Logging
Logging in Python
Modifying Log Levels
Logging Different Applications
Monitoring and Observability
Basics of Model Monitoring
Monitoring Drift with AWS SageMaker
Monitoring Drift with Azure ML
Conclusion
Exercises
Critical Thinking Discussion Questions

7. MLOps for AWS
Introduction to AWS
Getting Started with AWS Services
MLOps on AWS
MLOps Cookbook on AWS
CLI Tools
Flask Microservice
AWS Lambda Recipes
AWS Lambda-SAM Local
AWS Lambda-SAM Containerized Deploy
Applying AWS Machine Learning to the Real World
Conclusion
Exercises
Critical Thinking Discussion Questions

8. MLOps for Azure
Azure CLI and Python SDK
Authentication
Service Principal
Authenticating API Services
Compute Instances
Deploying
Registering Models
Versioning Datasets
Deploying Models to a Compute Cluster
Configuring a Cluster
Deploying a Model
Troubleshooting Deployment Issues
Retrieving Logs
Application Insights
Debugging Locally
Azure ML Pipelines
Publishing Pipelines
Azure Machine Learning Designer
ML Lifecycle
Conclusion
Exercises
Critical Thinking Discussion Questions

9. MLOps for GCP
Google Cloud Platform Overview
Continuous Integration and Continuous Delivery
Kubernetes Hello World
Cloud Native Database Choice and Design
DataOps on GCP: Applied Data Engineering
Operationalizing ML Models
Conclusion
Exercises
Critical Thinking Discussion Questions

10. Machine Learning Interoperability
Why Interoperability Is Critical
ONNX: Open Neural Network Exchange
ONNX Model Zoo
Convert PyTorch into ONNX
Create a Generic ONNX Checker
Convert TensorFlow into ONNX
Deploy ONNX to Azure
Apple Core ML
Edge Integration
Conclusion
Exercises
Critical Thinking Discussion Questions

11. Building MLOps Command Line Tools and Microservices
Python Packaging
The Requirements File
Command Line Tools
Creating a Dataset Linter
Modularizing a Command Line Tool
Microservices
Creating a Serverless Function
Authenticating to Cloud Functions
Building a Cloud-Based CLI
Machine Learning CLI Workflows
Conclusion
Exercises
Critical Thinking Discussion Questions

12. Machine Learning Engineering and MLOps Case Studies
Unlikely Benefits of Ignorance in Building Machine Learning Models
MLOps Projects at Sqor Sports Social Network
Mechanical Turk Data Labeling
Influencer Rank
Athlete Intelligence (AI Product)
The Perfect Technique Versus the Real World
Critical Challenges in MLOps
Ethical and Unintended Consequences
Lack of Operational Excellence
Focus on Prediction Accuracy Versus the Big Picture
Final Recommendations to Implement MLOps
Data Governance and Cybersecurity
MLOps Design Patterns
Conclusion
Exercises
Critical Thinking Discussion Questions

A. Key Terms
B. Technology Certifications
C. Remote Work
D. Think Like a VC for Your Career
E. Building a Technical Portfolio for MLOps
F. Data Science Case Study: Intermittent Fasting
G. Additional Educational Resources

Index