Machine Learning from Scratch

Machine Learning from Scratch covers statistical methods, machine learning algorithms, mathematical foundations, and practical implementations.

66 items · Page 1 of 2

Community

Learn with the community

Create a free account to keep your reading organized, join thoughtful discussions, and get more from every chapter.

  • Keep your place across books and articles
  • Ask questions and take part in discussions
  • Read with fewer interruptions

Free to join · Takes less than a minute

Why

I created this space so readers can learn together, ask questions, and make sense of difficult ideas.

Michael Brenndoerfer
From readers1 / 12
Data, Analytics & AIMachine LearningMachine Learning from Scratch

Hypothesis Testing: Test Selection and Reporting

Jan 10, 2026·18 min read

Practical reporting guidelines, summary of key concepts, test selection parameters table, multiple comparison corrections table.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

Multiple Comparisons: FWER, FDR, Bonferroni, Holm

Jan 9, 2026·29 min read

Control false positives across multiple hypothesis tests with FWER, FDR, Bonferroni, Holm, and Benjamini-Hochberg procedures.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

Effect Sizes and Statistical Significance: Cohen's d

Jan 8, 2026·20 min read

Cohen's d measures effect size separately from statistical significance. Covers practical significance and why small p-values can describe small effects.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

Sample Size, Minimum Detectable Effect & Power: Analysis

Jan 7, 2026·29 min read

Choose sample size and minimum detectable effect with power analysis. Covers underpowered studies, statistical sensitivity, and design tradeoffs.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

Type I and Type II Errors: False Positives, False Negatives

Jan 6, 2026·32 min read

Understanding false positives, false negatives, statistical power, and the tradeoff between error types. Balance Type I and Type II errors in study design.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

ANOVA (Analysis of Variance): One-Way ANOVA, Post-Hoc Tests

Jan 5, 2026·23 min read

One-way ANOVA, post-hoc tests, assumptions, and when to use ANOVA. Compare means across three or more groups while controlling Type I error rates.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

The F-Test and F-Distribution: Comparing Variances

Jan 4, 2026·24 min read

F-distribution, F-test for comparing variances, F-test in regression, and nested model comparison.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

The T-Test: One-Sample, Two-Sample (Pooled & Welch)

Jan 3, 2026·29 min read

Covers t-tests including one-sample, two-sample (pooled and Welch), paired tests, assumptions, and decision framework.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

Confidence Intervals and Test Assumptions

Jan 2, 2026·23 min read

Mathematical equivalence between confidence intervals and hypothesis tests, test assumptions (independence, normality, equal variances).

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

Z-Tests: One-Sample, Two-Sample and Proportion Tests

Jan 2, 2026·22 min read

Covers z-tests including one-sample, two-sample, and proportion tests. Topics include when to use z-tests, how to calculate test statistics.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

P-values and Hypothesis Test Setup

Jan 1, 2026·21 min read

Foundation of hypothesis testing covering p-values, null and alternative hypotheses, one-sided vs two-sided tests.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

DBSCAN: Density-Based Clustering for Arbitrary Shapes

Sep 10, 2025·58 min read

Covers DBSCAN (Density-Based Spatial Clustering of Applications with Noise), the algorithm.

Open notebook
Machine Learning from ScratchMachine LearningData, Analytics & AI

Quadratic Programming for Portfolio Optimization: Python

Sep 7, 2025·46 min read

Covers quadratic programming (QP) for portfolio optimization, including the mean-variance framework, efficient frontier construction.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratchoptimization

Vehicle Routing Problem with Time Windows

Sep 4, 2025·67 min read

Covers Vehicle Routing Problem with Time Windows (VRPTW), including mathematical formulation, constraint programming.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Minimum Cost Flow for Slotting and Resource Allocation

Sep 1, 2025·72 min read

Covers minimum cost flow optimization for slotting problems, including network flow theory, mathematical formulation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

MILP for Factory Optimization and Production Planning

Aug 29, 2025·67 min read

Covers Mixed Integer Linear Programming (MILP) for factory optimization, covering mathematical foundations, constraint modeling, branch-and-bound algorithms.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

CP-SAT Rostering: Constraint Programming for Workforce

Aug 26, 2025·56 min read

Covers CP-SAT rostering using Google OR-Tools to solve complex workforce scheduling problems with binary decision variables, coverage constraints.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratchtime-seriesdeep-learning

N-HiTS for Multi-Scale Time Series Forecasting

Aug 23, 2025·71 min read

Covers NHITS (Neural Hierarchical Interpolation for Time Series), a deep learning architecture for multi-scale time series forecasting.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

N-BEATS for Interpretable Time Series Forecasting

Aug 20, 2025·51 min read

Covers N-BEATS, an interpretable deep learning architecture for time series forecasting.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

HDBSCAN Clustering: Hierarchical Density-Based Clustering

Aug 17, 2025·37 min read

Covers HDBSCAN clustering algorithm covering density-based clustering, automatic cluster selection, noise detection.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Hierarchical Clustering: Dendrograms, Linkage Criteria

Aug 14, 2025·51 min read

Covers hierarchical clustering, including dendrograms, linkage criteria (single, complete, average, Ward), and scikit-learn implementation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

SARIMA: Seasonal Time Series Forecasting with Implementation

Aug 11, 2025·35 min read

Covers SARIMA (Seasonal AutoRegressive Integrated Moving Average) for forecasting time series with seasonal patterns.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Exponential Smoothing (ETS)

Aug 8, 2025·61 min read

Covers exponential smoothing for time series forecasting, including simple, double (Holt's), and triple (Holt-Winters) methods.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Prophet Time Series Forecasting: Trend, Seasonality

Aug 5, 2025·43 min read

Covers Prophet time series forecasting including additive decomposition, trend modeling, seasonal patterns, and holiday effects.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratchunsupervised-learning

K-means Clustering: Algorithm

Aug 2, 2025·91 min read

Covers K-means clustering from mathematical foundations to practical implementation. Topics include the algorithm, initialization strategies.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

t-SNE: Dimensionality Reduction & High-Dimensional Data

Jul 30, 2025·37 min read

Covers t-SNE (t-Distributed Stochastic Neighbor Embedding), including mathematical foundations, probability distributions, KL divergence optimization.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

LIME Explainability: Local Interpretable Model-Agnostic

Jul 27, 2025·31 min read

Covers LIME (Local Interpretable Model-Agnostic Explanations), including mathematical foundations, implementation strategies.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

UMAP: Uniform Manifold Approximation and Projection

Jul 24, 2025·40 min read

Covers UMAP dimensionality reduction, including mathematical foundations, fuzzy simplicial sets, manifold learning.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

PCA (Principal Component Analysis): Math & Implementation

Jul 21, 2025·23 min read

Covers Principal Component Analysis, including mathematical foundations, eigenvalue decomposition.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

XGBoost: Extreme Gradient Boosting

Jul 18, 2025·78 min read

Covers XGBoost (eXtreme Gradient Boosting), including second-order Taylor expansion, regularization techniques, split gain optimization, ranking loss functions.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

SHAP (SHapley Additive exPlanations): Model Interpretability

Jul 15, 2025·55 min read

Covers SHAP values covering mathematical foundations, feature attribution, and practical implementations for explaining any machine learning model.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

LightGBM: Fast Gradient Boosting

Jul 12, 2025·52 min read

Covers LightGBM gradient boosting framework, including leaf-wise tree growth, histogram-based binning, GOSS sampling, exclusive feature bundling.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

CatBoost: Categorical Boosting

Jul 9, 2025·42 min read

Covers CatBoost (Categorical Boosting), including categorical feature handling, target statistics, symmetric trees, ordered boosting, regularization techniques.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Isolation Forest: Unsupervised Anomaly Detection

Jul 6, 2025·48 min read

Covers Isolation Forest covering unsupervised anomaly detection, path length calculations, harmonic numbers, anomaly scoring.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Boosted Trees: Gradient Boosting Algorithm & Implementation

Jul 3, 2025·44 min read

Covers boosted trees and gradient boosting, covering ensemble learning, loss functions, sequential error correction, and scikit-learn implementation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Random Forest: Ensemble Learning

Jun 30, 2025·43 min read

Covers Random Forest covering ensemble learning, bootstrap sampling, random feature selection, bias-variance tradeoff, and implementation in scikit-learn.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

CART Decision Trees: Classification and Regression Trees

Jun 27, 2025·45 min read

Covers CART (Classification and Regression Trees), including mathematical foundations, Gini impurity, variance reduction.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Logistic Regression: Math & Python

Jun 24, 2025·46 min read

Covers logistic regression covering mathematical foundations, the logistic function, optimization algorithms, and practical implementation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Poisson Regression: Count Data Modeling with Math & Python

Jun 21, 2025·49 min read

Covers Poisson regression for count data analysis. Topics include mathematical foundations, maximum likelihood estimation, rate ratio interpretation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Spline Regression: Non-Linear Modeling with Math & Python

Jun 18, 2025·65 min read

Spline regression models nonlinear relationships with piecewise polynomials. Covers B-splines, knot selection, natural cubic splines, and Python.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Multinomial Logistic Regression: Math & Python

Jun 15, 2025·48 min read

Covers multinomial logistic regression covering mathematical foundations, softmax function, coefficient estimation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Elastic Net Regularization: Math & Python

Jun 12, 2025·52 min read

Covers Elastic Net regularization, including mathematical foundations, geometric interpretation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Polynomial Regression: Math and Python Implementation

Jun 9, 2025·38 min read

Model nonlinear relationships with polynomial regression. Covers feature construction, Python implementation, model selection, bias, variance, and overfitting.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Ridge Regression (L2 Regularization): Math & Implementation

Jun 6, 2025·36 min read

Covers Ridge regression and L2 regularization, including mathematical foundations, geometric interpretation, bias-variance tradeoff.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

Variable Relationships: Covariance, Correlation

Jun 3, 2025·26 min read

Compare covariance, correlation, and regression for relationships between variables. Covers interpretation, assumptions, pitfalls, and Python examples.

Open notebook
Data, Analytics & AIMachine Learning from Scratch

Data Quality & Outliers: Measurement Error, Missing Data

May 31, 2025·34 min read

Assess data quality through measurement error, systematic bias, missing-data mechanisms, and outlier detection. Covers diagnosis, treatment, and validation.

Open notebook
Data, Analytics & AIMachine LearningMachine Learning from Scratch

Statistical Modeling: Overfitting, Bias and Variance

May 28, 2025·19 min read

Covers statistical modeling fundamentals, including measuring model fit with R-squared and RMSE.

Open notebook
Data, Analytics & AIdata-scienceMachine Learning from Scratch

Data Visualization: Histograms, Box Plots and Scatter Plots

May 25, 2025·17 min read

Covers core data visualization techniques including histograms, box plots, and scatter plots. Topics include distributions, identify outliers.

Open notebook
Community

Learn with the community

Create a free account to keep your reading organized, join thoughtful discussions, and get more from every chapter.

  • Keep your place across books and articles
  • Ask questions and take part in discussions
  • Read with fewer interruptions

Free to join · Takes less than a minute

Why

I created this space so readers can learn together, ask questions, and make sense of difficult ideas.

Michael Brenndoerfer
From readers1 / 12