Skip to content
Tutorials Center
My learning

Topics

Data Science Tutorial

Learn Data Science step by step: 76 lessons in 12 chapters with examples, quizzes, diagrams and projects.

Start learning →

of lessons completed

What Data Science Is

  1. 1 What Is Data Science? Learn what data science is, what data scientists actually do, how a project goes from question to decision, and run a tiny end-to-end analysis in Python.
  2. 2 Data Science vs Data Analytics, Applications and Roles Compare data science, data analytics, business intelligence and machine learning engineering, see the four kinds of questions each answers, and tour real applications by industry.
  3. 3 The Data Science Workflow Walk through the data science workflow stage by stage, see what each stage produces, where the time really goes, and build a script-friendly pipeline of functions.
  4. 4 Data Processing: Batch, Real-time and Online Learn the stages of data processing and the main types: batch, real-time (stream), online (interactive) and offline processing, with trade-offs and runnable pandas examples.
  5. 5 Framing a Good Question Turn a vague business request into a testable data question: choose metrics, write hypotheses, set success criteria and baselines, and know when data cannot help.
  6. 6 Types of Data and Measurement Learn the levels of measurement, numeric versus categorical data, time series, text and nested data, units, granularity and tidy tables, with pandas dtypes in action.
  7. 7 Python Libraries for Data Science, ML and Deep Learning A map of the Python data ecosystem: arrays, tables, statistics, plotting, machine learning, deep learning, NLP, big data and tooling, with one runnable demo per core library.

Math Foundations

  1. 8 Linear Algebra for Data Science Learn the linear algebra data scientists use: vectors as rows of data, dot products and similarity, matrices as tables, least squares, eigenvectors and SVD, with NumPy.
  2. 9 Calculus and Optimization for Data Science Understand derivatives, gradients and gradient descent with plain NumPy: minimize a loss by hand, choose a learning rate, fit a line step by step and avoid local minima.

Getting Data

  1. 10 Where Data Comes From Survey where analysis data comes from: files, databases, APIs, logs, surveys and experiments, plus scraping basics, public datasets and data contracts.
  2. 11 Collecting Data from APIs and Web Pages Collect data for analysis from JSON APIs and web pages: requests, pagination, rate limits, API keys, caching raw responses, HTML tables, and polite, legal scraping.
  3. 12 Loading Data from CSV, JSON and SQL Load data with pandas read_csv, read_json and read_sql: dtypes and dates, encodings, chunking, SQLAlchemy with in-memory SQLite, and checks after loading.
  4. 13 SQL for Data Analysis Use SQL in a data science workflow: filter and aggregate in the database, join tables, use CTEs and window functions, pass parameters safely and load results into pandas.
  5. 14 Data Warehouses, ETL and Metadata Understand how analytics data is stored: warehouse components, ETL versus ELT, star schemas, OLAP queries, and the types of metadata and data lineage that keep numbers trustworthy.
  6. 15 Sampling and Collection Bias Learn population vs sample, random, stratified and cluster sampling, and how selection, survivorship and response bias distort data, with live simulations.
  7. 16 Generating Synthetic Data for Practice Generate realistic practice datasets with seeded NumPy generators: noise, missing values, outliers and duplicates, plus a known ground truth to test methods.

Cleaning and Preparing Data

  1. 17 Auditing Data Quality Audit a dataset before using it: shape, dtypes, completeness, uniqueness, validity, consistency and timeliness, plus a reusable profiling function in pandas.
  2. 18 Handling Missing Values Decide how to handle missing data: MCAR, MAR and MNAR, dropping vs filling vs flagging, mean, median and group imputation, indicators and leakage.
  3. 19 Outliers, Errors and Impossible Values Detect outliers with IQR and z-score rules, catch impossible values with domain rules, and choose between keeping, fixing, winsorizing or removing them.
  4. 20 Cleaning Text and Categories Clean messy labels in pandas: whitespace, case and accents, fuzzy duplicates, typo mapping, rare-category grouping, and parsing messy prices, units and dates.
  5. 21 Feature Engineering Turn raw columns into useful features: ratios, date parts, bins, interactions, per-customer aggregates and log transforms, and avoid target leakage along the way.
  6. 22 Feature Selection: Filter, Wrapper and Embedded Methods Choose the features that matter: filter methods (variance, correlation, mutual information), wrapper methods (RFE, forward selection) and embedded methods (Lasso, trees), without leakage.
  7. 23 Encoding and Scaling Features Prepare features for models: one-hot and ordinal encoding, target encoding pitfalls, standard, min-max and robust scaling, power transforms and ColumnTransformer.

Exploratory Data Analysis

  1. 24 A Systematic EDA Process Learn a repeatable exploratory data analysis routine: look at the table, then single variables, pairs and groups, record findings and avoid fishing expeditions.
  2. 25 Looking at One Variable at a Time Explore a single variable with histograms, density curves, boxplots and summary tables: choose bin counts, read skewness and spot outliers and odd spikes.
  3. 26 Relationships Between Variables Explore how columns relate: scatter plots, correlation matrices, grouped comparisons, cross-tabs, Simpson's paradox, and why correlation is not causation.
  4. 27 Trends, Seasonality and Time Patterns Explore time series data: resample to months, smooth with rolling means, split trend and seasonality with statsmodels, compare year over year and flag anomalies.

Visualization and Storytelling

  1. 28 Principles of Effective Visualization Choose the right chart, use position and length for accuracy, pick accessible colors, remove clutter, label directly and avoid misleading axes, with live before/after charts.
  2. 29 Matplotlib for Analysts Use matplotlib's object-oriented API for analysis: figures and axes, subplots, annotations, styles, small multiples and saving charts, with live examples.
  3. 30 Seaborn for Analysts: Count, Strip, Violin, KDE, Joint, Reg and Pair Use Seaborn the analyst's way: pick count, strip, violin, KDE, joint, regression and pair plots by the question you are asking, and read each chart honestly.
  4. 31 Interactive Charts with Plotly: Scatter, Bar, Line, Animation and Maps Build quick interactive charts with Plotly Express: scatter, bar, line, animated and choropleth maps, and see the figure data behind each call with runnable Python stand-ins.
  5. 32 Showing Distributions and Uncertainty Draw violin plots, ECDFs, error bars and bootstrapped confidence bands in matplotlib, and learn how to show uncertainty honestly in data science charts.
  6. 33 Communicating Results to Non-Experts Turn analysis into decisions: know your audience, write the one-sentence finding, structure a report, choose tables or charts, and state caveats honestly.
  7. 34 Spreadsheets and BI Tools in the Workflow Learn where spreadsheets and BI tools fit next to Python: map Excel formulas to pandas, prepare tidy tables for dashboards, plan hand-offs and keep one source of truth.

Statistics for Data Science

  1. 35 Descriptive Statistics in Practice Choose the right summary: mean vs median, spread measures, percentiles, weighted averages and grouped summaries with pandas, and avoid common traps.
  2. 36 Probability and Distributions You Will Meet Meet the normal, binomial, Poisson, exponential, uniform and long-tailed distributions, and see the law of large numbers and central limit theorem in simulations.
  3. 37 More Probability Distributions - Bernoulli, Exponential, Gamma, Beta, Chi-Squared Learn the distributions behind tests and models: Bernoulli, uniform, exponential, gamma, beta, chi-squared, t and F, with formulas, Python code and where each one is used.
  4. 38 Inferential and Parametric Methods Overview Understand inferential statistics: estimation versus testing, sampling distributions and standard error, what parametric methods assume, and when to use nonparametric or bootstrap methods.
  5. 39 ANOVA and F-Tests - One-Way, Two-Way and the F-Ratio Understand the F-distribution, the F-test for variances, one-way ANOVA by hand and in SciPy, two-way ANOVA with interaction, and post-hoc tests, with runnable Python.
  6. 40 Chi-Square Tests - Goodness of Fit and Independence Learn the chi-square goodness-of-fit and independence tests: expected counts, degrees of freedom, assumptions, Cramer's V effect size and checking model fit, with Python.
  7. 41 Estimation and Confidence Intervals Learn standard error, t-based confidence intervals and the bootstrap in Python, plus what a 95% interval really means, with live simulations you can run.
  8. 42 Hypothesis Testing Done Right Understand null hypotheses, p-values, t-tests, chi-square, nonparametric tests, effect sizes and multiple comparisons, with live Python examples and common traps.
  9. 43 A/B Testing and Experiments Design and analyze A/B tests in Python: randomization, metrics, power and sample size, the peeking problem and how to interpret lift, with live simulations.
  10. 44 Causal Thinking and Confounding Learn why correlation is not causation: confounders, colliders, DAG diagrams, randomization versus observational data, and regression adjustment with live Python.
  11. 45 Bayesian Thinking for Analysts A practical intro to Bayesian thinking: priors, likelihood, posterior updating with the beta-binomial model, grid approximation and credible intervals, in live Python.

Modelling

  1. 46 Models, Learning and the Modelling Loop Understand supervised vs unsupervised learning, regression vs classification, signal and noise, the bias-variance trade-off and baselines, with live scikit-learn examples.
  2. 47 Linear Regression for Inference and Prediction Fit linear regression with statsmodels and scikit-learn, read the coefficient table, check residual diagnostics and multicollinearity, and interpret results.
  3. 48 Classification with Logistic Regression Learn logistic regression for classification: odds and probabilities, statsmodels and scikit-learn, choosing a threshold, and handling imbalanced classes.
  4. 49 Decision Trees, Random Forests and Boosting Understand decision trees, overfitting, bagging in random forests and gradient boosting with scikit-learn, and why feature importance can mislead.
  5. 50 Train/Test Splits and Cross-Validation Learn holdout splits, k-fold and stratified cross-validation, time-series splits and data leakage, with live scikit-learn examples that show how leaks fool you.
  6. 51 Evaluating Models with the Right Metrics Pick the right metric: MAE, RMSE and R2 for regression, confusion matrices, precision, recall, F1, ROC and PR curves, calibration and cost-based choices.
  7. 52 Pipelines and Hyperparameter Tuning Build leak-free scikit-learn pipelines with ColumnTransformer, tune hyperparameters with grid and randomized search, and know when a simple model is enough.
  8. 53 Clustering and Segmentation Group customers without labels: scale features, run k-means and hierarchical clustering, choose k with inertia and silhouette, and profile each segment.
  9. 54 Association Rules and Market Basket Analysis Find items that are bought together: build a basket table, compute support, confidence and lift in pandas, write a small Apriori from scratch, and avoid misleading rules.
  10. 55 Dimensionality Reduction and Visualization of High-D Data Reduce many columns to a few with PCA: explained variance, scree plots, loadings, PCA in a pipeline, and why t-SNE pictures need careful reading.
  11. 56 Forecasting Basics Forecast monthly data: naive and seasonal-naive baselines, moving averages, exponential smoothing, ARIMA with statsmodels, and honest rolling backtests.
  12. 57 Working with Text Data Turn text into numbers with tokenizing, bag of words and TF-IDF, then train and evaluate a support-ticket classifier with scikit-learn pipelines.
  13. 58 Explaining Model Behaviour Look inside any model: read coefficients with care, use permutation importance and partial dependence, and find weak spots with residual and segment error analysis.

Reproducibility and Production Habits

  1. 59 Reproducible Analysis Make analyses repeatable: project layout, random seeds, pinned environments, data fingerprints, config files, run manifests, and notebooks versus scripts.
  2. 60 Testing Data Code and Data Validation Test data science code: validate schema and value ranges, write unit tests for transforms with small fixtures, and check properties on random inputs.
  3. 61 From Model to Decision and Deployment Turn a trained model into something useful: batch vs real-time scoring, saving models with joblib, choosing a decision threshold by cost, and monitoring drift.

Ethics, Privacy and Judgement

  1. 62 Ethics, Fairness and Responsible Data Use Learn privacy and consent basics, why anonymised data can be re-identified, how proxy variables leak group bias, and how to compare error rates across groups.

Projects

  1. 63 Project: Customer Churn Analysis A complete churn analysis on synthetic subscription data: frame the question, clean, explore, compare models with a baseline, and turn scores into recommendations.
  2. 64 Project: Sales Dashboard and Forecast Build a sales dashboard and a six-month forecast in Python: aggregate orders, find seasonality, backtest simple models, draw an uncertainty band, write the summary.
  3. 65 Project: Experiment Readout Analyse a simulated A/B test end to end in Python: power plan, health checks, conversion test, confidence interval, guardrails, segments and a decision memo.
  4. 66 Project: House Price Model Build a house price model end to end: audit synthetic housing data, engineer features, compare regression models with cross-validation, and study residuals.
  5. 67 Project: Survey Analysis Turn messy survey responses into findings: standardize free text, parse Likert answers, run grouped tests with effect sizes, draw charts, and write the report.
  6. 68 Projects: Wine, Fraud Detection, Loan Approval and Heart Disease Four compact classification projects with scikit-learn: wine classes, imbalanced fraud detection, loan approval with a fairness check, and a heart-disease risk model with calibration.
  7. 69 Project: Scrape and Analyse Product Prices Build a small scraping and analysis pipeline: fetch paginated product pages politely, parse HTML with BeautifulSoup, clean messy prices, track price changes and report the findings.

Practice and Review

  1. 70 Practice Exercises with Solutions 22 graded data science exercises with worked solutions: cleaning, exploratory analysis, statistics and modelling. Practice in your browser with ready data.
  2. 71 Common Data Science Mistakes Six costly data science mistakes shown with live simulations: leakage, reusing the test set, base rates, p-value misreadings, survivorship bias and over-cleaning.
  3. 72 Data Science Interview Questions 40 data science interview questions with model answers: statistics, machine learning, SQL and pandas, case-style problems and behavioural questions.
  4. 73 Interview Questions: Databases, Python and Statistics More data science interview questions with runnable answers: lifecycle, Python data structures, SQL and databases, probability axioms, skewness, p-values, ANOVA.
  5. 74 Interview Questions: Machine Learning and Deep Learning Machine learning and deep learning interview questions with short answers and runnable demos: imbalance, pruning, boosting, losses, SVMs, LSTMs, GANs and LLMs.
  6. 75 Coding Interview Questions for Data Science Coding interview questions for data science with runnable Python, NumPy and SQL answers: recursion, Kadane, LRU cache, BFS and DFS, knapsack, CTEs and more.
  7. 76 Data Science Cheat Sheet A one-page data science cheat sheet: project checklist, metric chooser, statistical test chooser, model chooser and runnable pandas, scikit-learn and SciPy snippets.