Implementing MLOps in the Enterprise

Finding the AI Use Case
Defining Goals and Evaluating the ROI
How to Build a Successful ML Project
Approving and Prototyping the Project
Scaling and Productizing Projects
Project Structure and Lifecycle
ML Project Example from A to Z
Exploratory Data Analysis
Data and Model Pipeline Development
Application Pipeline Development
Scaling and Productizing the Project
CI/CD and Continuous Operations
Conclusion
Critical Thinking Discussion Questions
Exercises

4. Working with Data and Feature Stores
Data Versioning and Lineage
How It Works
Common ML Data Versioning Tools
Data Preparation and Analysis at Scale
Structured and Unstructured Data Transformations
Distributed Data Processing Architectures
Interactive Data Processing
Batch Data Processing
Stream Processing
Stream Processing Frameworks
Feature Stores
Feature Store Architecture and Usage
Ingestion and Transformation Service
Feature Storage
Feature Retrieval (for Training and Serving)
Feature Stores Solutions and Usage Example
Using Feast Feature Store
Using MLRun Feature Store
Conclusion
Critical Thinking Discussion Questions
Exercises

5. Developing Models for Production
AutoML
Running, Tracking, and Comparing ML Jobs
Experiment Tracking
Saving Essential Metadata with the Model Artifacts
Comparing ML Jobs: An Example with MLflow
Hyperparameter Tuning
Auto-Logging
MLOps Automation: AutoMLOps
Example: Running and Tracking ML Jobs Using Azure Databricks
Handling Training at Scale
Building and Running Multi-Stage Workflows
Managing Computation Resources Efficiently
Conclusion
Critical Thinking Discussion Questions
Exercises

6. Deployment of Models and AI Applications
Model Registry and Management
Solution Examples
SageMaker Example
MLflow Example
MLRun Example
Model Serving
Amazon SageMaker
Seldon Core
MLRun Serving
Advanced Serving and Application Pipelines
Implementing Scalable Application Pipelines
Model Routing and Ensembles
Model Optimization and ONNX
Data and Model Monitoring
Integrated Model Monitoring Solutions
Standalone Model Monitoring Solutions
Model Retraining
When to Retrain Your Models
Strategies for Data Retraining
Model Retraining in the MLOps Pipeline
Deployment Strategies
Measuring the Business Impact
Conclusion
Critical Thinking Discussion Questions
Exercises

7. Building a Production Grade MLOps Project from A to Z
Exploratory Data Analysis
Interactive Data Preparation
Preparing the Credit Transaction Dataset
Preparing the User Events (Activities) Dataset
Extracting Labels and Training a Model
Data Ingestion and Preparation Using a Feature Store
Building the Credit Transactions Data Pipeline (Feature Set)
Building the User Events Data Pipeline (FeatureSet)
Building the Target Labels Data Pipeline (FeatureSet)
Ingesting Data into the Feature Store
Model Training and Validation Pipeline
Creating and Evaluating a Feature Vector
Building and Running an Automated Training and Validation Pipeline
Real-Time Application Pipeline
Defining a Custom Model Serving Class
Building an Application Pipeline with Enrichment and Ensemble
Testing the Application Pipeline Locally
Deploying and Testing the Real-Time Application Pipeline
Model Monitoring
CI/CD and Continuous Operations
Conclusion
Critical Thinking Discussion Questions
Exercises

8. Building Scalable Deep Learning and Large Language Model Projects
Distributed Deep Learning
Horovod
Ray
Data Gathering, Labeling, and Monitoring in DL
Data Labeling Pitfalls to Avoid
Data Labeling Best Practices
Data Labeling Solutions
Using Foundation Models as Labelers
Monitoring DL Models with Unstructured Data
Build Versus Buy Deep Learning Models
Foundation Models, Generative AI, LLMs
Risks and Challenges with Generative AI
MLOps Pipelines for Efficiently Using and Customizing LLMs
Application Example: Fine-Tuning an LLM Model
Conclusion
Critical Thinking Discussion Questions
Exercises

9. Solutions for Advanced Data Types
ML Problem Framing with Time Series
Navigating Time Series Analysis with AWS
Diving into Time Series with DeepAR+
Time Series with the GCP BigQuery and SQL
Build Versus Buy for MLOps NLP Problems
Build Versus Buy: The Hugging Face Approach
Exploring Natural Language Processing with AWS
Exploring NLP with OpenAI
Video Analysis, Image Classification, and Generative AI
Image Classification Techniques with CreateML
Composite AI
Getting Started with Serverless for Composite AI
Use Cases of Composite AI with Serverless
Conclusion
Critical Thinking Discussion Questions
Exercises

10. Implementing MLOps Using Rust
The Case for Rust for MLOps
Leveling Up with Rust, GitHub Copilot, and Codespaces
In the Beginning Was the Command Line
Getting Started with Rust for MLOps
Using PyTorch and Hugging Face with Rust
Using Rust to Build Tools for MLOps
Building Containerized Rust Command-Line Tools
GPU PyTorch Workflows
Using TensorFlow Rust
Doing k-means Clustering with Rust
Final Notes on Rust
Ruff Linter
rust-new-project-template
Conclusion
Critical Thinking Discussion Questions
Exercises

A. Job Interview Questions
B. Enterprise MLOps Interviews

Index
About the Authors