Skip to content
Tutorials Center
My learning

Topics

Data Mining Tutorial

Learn Data Mining step by step: 39 lessons in 9 chapters with examples, quizzes, diagrams and projects.

Start learning →

of lessons completed

Getting Started

  1. 1 What Is Data Mining? Learn what data mining is, how it differs from statistics and machine learning, what patterns it finds, and where it is used, with runnable Python examples.
  2. 2 The KDD Process and CRISP-DM Follow the steps of knowledge discovery (KDD) and the CRISP-DM cycle, from business understanding to deployment, and run a miniature pipeline end to end in Python.
  3. 3 Data Mining Tasks and Applications A tour of the main data mining tasks: classification, regression, clustering, association rules, anomaly detection and more, with a tiny Python example for each.
  4. 4 Data Types and Data Quality Learn attribute types (nominal, ordinal, interval, ratio), kinds of data sets, metadata, and how to measure data quality: accuracy, completeness, consistency and more.
  5. 5 Data Warehouses and OLAP Understand data warehouse components, star schemas, ETL, metadata and OLAP operations like roll-up, drill-down and slice, with pandas examples you can run.

Data Preprocessing

  1. 6 Data Cleaning Clean data before mining: handle missing values, smooth noise with binning, remove duplicates, fix inconsistent labels and treat outliers, using pandas examples.
  2. 7 Data Integration and Reduction Combine data from several sources, detect redundant attributes, then shrink data with sampling, feature selection and PCA. Runnable pandas and scikit-learn examples.
  3. 8 Data Transformation Transform data for mining: min-max and z-score scaling, log transforms, discretization (binning), one-hot and ordinal encoding, and feature construction with Python.
  4. 9 Similarity and Distance Measures Learn Euclidean, Manhattan, Minkowski, cosine, Jaccard, Hamming and Gower measures, when to use each, and how to compute them in Python with scipy and NumPy.
  5. 10 Building a Preprocessing Pipeline Combine cleaning, imputation, scaling and encoding into one reusable scikit-learn pipeline that avoids data leakage, with a complete worked example you can run.

Exploration and Visualization

  1. 11 Descriptive Statistics and Distributions Describe a data set with measures of center, spread and shape: mean, median, mode, variance, quantiles, skewness and kurtosis, plus the five-number summary in pandas.
  2. 12 Visualizing Data Choose the right plot for exploring data: histograms, box plots, scatter plots, bar charts, heatmaps and pair plots, with matplotlib code that runs in your browser.
  3. 13 Correlation and Relationships Measure how attributes relate: Pearson and Spearman correlation, covariance, chi-square for categories, mutual information, and why correlation is not causation.
  4. 14 Hypothesis Testing for Data Miners Learn null and alternative hypotheses, p-values, t-tests, z-tests, chi-square tests, Type I and II errors and confidence intervals, with runnable scipy examples.
  5. 15 Probability Distributions for Data Mining Meet the distributions that data mining uses: normal, binomial, Poisson, exponential, uniform, lognormal and more, with simulations and fits in scipy.

Association Rules

  1. 16 Frequent Itemsets and Market Basket Analysis Learn market basket analysis from scratch: transactions, itemsets, support, confidence, lift, and how rules like bread implies butter are formed, with Python code.
  2. 17 The Apriori Algorithm Understand and implement the Apriori algorithm: level-wise candidate generation, the pruning property, rule generation and optimizations, with complete runnable Python.
  3. 18 The FP-Growth Algorithm Learn FP-Growth, the faster alternative to Apriori: build a compact FP-tree, mine conditional pattern bases recursively, and compare results with Apriori in Python.
  4. 19 Association Rule Types and Measures Explore multilevel, multidimensional and quantitative association rules, closed and maximal itemsets, interestingness measures like lift and conviction, and associative classification.

Classification

  1. 20 Classification Basics Learn what classification means in data mining: labels, training and test sets, overfitting, the confusion matrix and the metrics (accuracy, precision, recall, F1) with runnable code.
  2. 21 Decision Trees in Data Mining Understand how decision tree induction works: entropy, information gain, Gini impurity, gain ratio, stopping rules, pruning and reading the rules a tree learns, with runnable code.
  3. 22 Nearest Neighbors and Naive Bayes Learn two classic classifiers: k-nearest neighbors (lazy learning, distance, scaling, choosing k) and Naive Bayes (Bayes rule, independence, smoothing), built from scratch and with scikit-learn.
  4. 23 Rule-Based and Associative Classification Learn IF-THEN rule classifiers: coverage and accuracy, sequential covering (1R, RIPPER-style), and associative classification (CBA) that mines class association rules, with Python code.
  5. 24 Ensembles and Support Vector Machines Improve classifiers with bagging, random forests and boosting, then learn support vector machines, margins and kernels. Compare models with cross-validation and ROC AUC in runnable Python.
  6. 25 Prediction in Data Mining Predict numbers instead of categories: linear regression, regularization, tree regressors, error metrics (MAE, RMSE, R2) and a first look at time-based forecasting, with runnable Python examples.

Clustering

  1. 26 Clustering Basics Learn what clustering is, how it differs from classification, the main method families (partitioning, hierarchical, density, grid, model-based) and why scaling and distance choices shape clusters.
  2. 27 k-Means and Its Variants Implement k-means from scratch, then learn k-means++ initialization, choosing k with the elbow and silhouette, k-medoids (PAM) for robustness and MiniBatch k-means for big data.
  3. 28 Hierarchical Clustering Learn agglomerative and divisive hierarchical clustering: distance matrices, single, complete, average and Ward linkage, dendrograms, cutting the tree, and BIRCH, CURE and Chameleon for large data.
  4. 29 Density-Based and Grid-Based Clustering Learn density-based clustering with DBSCAN (eps, min_samples, core, border and noise points), choosing eps, OPTICS for varying density, and grid-based methods like STING and CLIQUE.
  5. 30 Evaluating Clusters Judge a clustering without guessing: clustering tendency (Hopkins), internal indices (silhouette, Calinski-Harabasz, Davies-Bouldin), external indices (ARI, NMI, purity) and stability checks.

Anomaly Detection

  1. 31 Outlier Detection: Statistical Methods Detect outliers and anomalies with statistics: types of outliers, z-score, modified z-score (MAD), the IQR rule, Grubbs test, Mahalanobis distance, Gaussian fitting and what to do with outliers.
  2. 32 Distance and Density Anomaly Detection Detect anomalies with distance (k-NN), density (Local Outlier Factor), isolation (Isolation Forest), clustering and One-Class SVM; learn contamination, scoring and how to evaluate rare-event detectors.

Text and Web Mining

  1. 33 Text Mining Basics Turn text into data: tokenization, stop words, stemming, bag of words, n-grams, TF-IDF, cosine similarity, and document classification and clustering with runnable Python examples.
  2. 34 Web Mining and PageRank Understand the three kinds of web mining (content, structure, usage), build PageRank and HITS from scratch, parse HTML links, and sessionize clickstream logs with runnable Python examples.
  3. 35 Topic Modeling and Sentiment Analysis Discover hidden topics with NMF and LDA, then measure opinion with lexicon-based and machine-learning sentiment analysis, handle negation, and extract entities with regular expressions.

Projects and Practice

  1. 36 Project: Customer Segmentation Build a customer segmentation end to end: simulate transactions, engineer RFM features, scale, choose k, run k-means, profile each segment, validate stability and turn clusters into actions.
  2. 37 Project: Fraud Detection Detect rare fraudulent transactions: simulate imbalanced data, see why accuracy fails, train supervised and unsupervised detectors, tune the threshold by cost and report precision and recall.
  3. 38 Project: Spam Filter and Topic Explorer A text mining project: build a spam filter with TF-IDF and Naive Bayes, inspect the words that drive it, evaluate with precision and recall, then explore unlabeled messages with topics.
  4. 39 Practice Exercises Practice classification, clustering, anomaly detection and text mining with six hands-on exercises, editable starter code, hints and worked solutions, plus a self-check quiz and a final checklist.