Skip to content
Tutorials Center
My learning

Topics

MLOps Tutorial

Learn MLOps step by step: 41 lessons in 9 chapters with examples, quizzes, diagrams and projects.

Start learning →

of lessons completed

Getting Started

  1. 1 What Is MLOps? Learn what MLOps is, why a trained model is only the start, and how it borrows ideas from DevOps to ship, run and maintain machine learning systems reliably.
  2. 2 Technical Debt in Machine Learning Systems See why the model is a small box in a big system: entanglement, data dependencies, feedback loops, glue code and configuration debt, with runnable examples.
  3. 3 MLOps Maturity Levels Understand the stages of MLOps maturity, from manual notebooks to automated pipelines with continuous training, and score your own project with a runnable checklist.
  4. 4 MLOps Roles and the Tool Landscape Meet the people in an ML team and the families of MLOps tools (tracking, versioning, orchestration, serving, monitoring), and learn how to pick tools without chasing hype.

ML Lifecycle and Pipelines

  1. 5 The Machine Learning Lifecycle Walk through every stage of the machine learning lifecycle (framing, data, training, evaluation, deployment, monitoring) and see how each stage produces versioned artifacts.
  2. 6 A Reproducible Training Script Turn a notebook into a reproducible training script: fix seeds, split data deterministically, pin settings, save a run record, and prove two runs give identical results.
  3. 7 scikit-learn Pipelines for Production Bundle preprocessing and model into one scikit-learn Pipeline and ColumnTransformer so training and serving use identical steps, with leakage checks and examples.
  4. 8 Pipeline Orchestration and DAGs Understand tasks, dependencies and DAGs, build a tiny orchestrator with retries and caching in Python, and see how Airflow, Prefect and Kubeflow express the same ideas.
  5. 9 Configuration and Parameters Keep hyperparameters and paths out of code: use config files, typed dataclasses, defaults and overrides, validate them early, and store the exact config with every run.

Data and Experiment Tracking

  1. 10 Data Versioning and Fingerprints Learn why Git cannot version big datasets, how content hashes identify a dataset exactly, and how tools like DVC and lakeFS apply the same idea. Includes a runnable mini data store.
  2. 11 Data Validation and Schemas Stop bad data before it reaches your model: write schema checks for types, ranges and missing values, validate new batches against training statistics, and fail fast in pipelines.
  3. 12 Feature Engineering and Feature Stores Learn how to share feature code between training and serving, avoid training-serving skew, and use point-in-time correct joins, the core idea behind every feature store.
  4. 13 Experiment Tracking Basics Learn what an experiment run records, build a small tracker in plain Python, compare runs, and see how tools like MLflow and Weights and Biases structure the same idea.
  5. 14 Comparing Experiments and Tuning Learn how to compare model runs fairly with cross-validation and seeds, run grid and random hyperparameter searches, and log every trial so the best model can be justified.

Model Packaging and Registry

  1. 15 Saving and Loading Models Learn how to serialize trained models with pickle and joblib, why version mismatches and untrusted pickles are dangerous, and when portable formats such as ONNX are the better choice.
  2. 16 Model Metadata and Model Cards Learn what metadata every saved model needs, how to generate a model card with intended use, metrics per group and limitations, and how to check that documentation is complete.
  3. 17 Model Registry and Stages Learn what a model registry stores, how versions move through staging and production with approval checks, how aliases make rollback instant, and build a small registry in Python.
  4. 18 Packaging and Environments Learn why a model needs its exact environment, how to pin and lock dependencies, how to capture package versions, and how to detect environment mismatches before deployment.
  5. 19 Containerizing a Model Learn how to package a model service in a Docker image, write a lean Dockerfile with cached layers, add a health check and non-root user, and verify the container before you ship it.

CI/CD for ML

  1. 20 CI/CD for Machine Learning See how continuous integration and delivery change when a model is involved: code, data and models all trigger pipelines, and each stage has its own checks.
  2. 21 Testing ML Code Write unit tests for feature code, shape and sanity tests for models, and behavioral tests (invariance, direction, minimum functionality) that run in CI.
  3. 22 Data Validation in CI Stop bad data before it reaches training: write schema, range, null, category and freshness checks with pandas and fail the pipeline with a clear report.
  4. 23 Model Quality Gates Decide automatically whether a trained model may be promoted: absolute floors, champion comparison, slice checks, latency budgets and noise-aware thresholds.
  5. 24 Continuous Training Pipelines Wire data checks, training, evaluation and registration into one automated pipeline that skips unchanged work, stops on failure and records every run.

Serving and Monitoring

  1. 25 Batch and Online Model Serving Choose between batch, online (real-time) and streaming inference. Compare latency, cost and freshness, and see working examples of batch scoring and a cached online predictor.
  2. 26 Building a Prediction Service Design a model prediction API: typed request validation with pydantic, health and readiness checks, versioned responses, error handling, and a FastAPI sketch.
  3. 27 Latency, Throughput and Load Measure model serving speed the right way: p50/p95/p99 latency, throughput, Little's law for capacity planning, and a queue simulation that shows why spikes hurt.
  4. 28 Safe Rollouts: Canary, Shadow and A/B Release a new model without betting everything on it: shadow mode, canary traffic splits with automatic rollback, A/B tests with significance, and blue-green swaps.
  5. 29 Monitoring Service Health Monitor a deployed model like any production service: request rate, errors, latency histograms, Prometheus-style metrics, structured logs, SLOs and sensible alerts.

Drift Detection and Retraining

  1. 30 Understanding Data and Concept Drift Learn why models decay after deployment: covariate shift, label shift and concept drift, sudden versus gradual change, and simulations showing how each one hurts accuracy.
  2. 31 Detecting Data Drift Compare live data with a reference using the Kolmogorov-Smirnov test, Population Stability Index, chi-square and a domain classifier, and learn when each is the right tool.
  3. 32 Monitoring Model Performance Track live model quality when ground truth arrives late: rolling metrics, label delay, proxy signals, slice monitoring and alert rules with worked Python examples.
  4. 33 Retraining Triggers and Strategies Decide when to retrain (schedule, drift, performance) and how (expanding, sliding window, weighted data), with simulations that compare the strategies in Python.
  5. 34 Automating the Retraining Loop Close the MLOps loop in code: monitor a live model, trigger retraining, gate the candidate, promote or reject it, roll back on regression and keep an audit log.

Governance and Tooling

  1. 35 Model Cards and Documentation Write a model card that states intended use, data, metrics by slice and known limits, generate it from code, and check in CI that no card ships incomplete.
  2. 36 Fairness and Bias Checks Measure group-level differences in selection rate and error rates, understand the trade-offs between fairness definitions, and add bias checks to the release gate.
  3. 37 Lineage and Audit Trails Record which data, code, parameters and approvals produced each model and prediction, so you can reproduce results, answer audits and trace incidents.
  4. 38 The MLOps Tooling Landscape A map of MLOps tool categories (tracking, data, orchestration, serving, monitoring, platforms), a build-versus-buy method and a weighted scoring exercise in Python.

Projects and Practice

  1. 39 Project: An End-to-End Mini MLOps Pipeline Build a small but complete MLOps pipeline: validate data, fingerprint, train, gate, register, document, serve predictions and log them with lineage.
  2. 40 Project: A Drift Monitoring Report Build a weekly drift and performance report: PSI and KS per feature, prediction shift, delayed-label accuracy, alert rules and a chart you can run in the browser.
  3. 41 Practice: MLOps Exercises Six hands-on MLOps exercises: schema checks, run fingerprints, gates, drift tests, delayed-label metrics and rollback logic, each with a starter and a solution.