Machine Learning

Articles about traditional machine learning, optimization, bayesian methods, and other machine learning topics.

747 items · Page 1 of 16

Community

Learn with the community

Create a free account to keep your reading organized, join thoughtful discussions, and get more from every chapter.

  • Keep your place across books and articles
  • Ask questions and take part in discussions
  • Read with fewer interruptions

Free to join · Takes less than a minute

Why

I created this space so readers can learn together, ask questions, and make sense of difficult ideas.

Michael Brenndoerfer
From readers1 / 12
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Forecasting Baselines, Temporal Validation, and Backtesting

Oct 30, 2026·51 min read

Build naive, seasonal-naive, and drift baselines, then validate forecasts with rolling-origin backtesting, horizon-specific errors, and honest reporting.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Genetic Algorithms

Oct 29, 2026·59 min read

Genetic algorithms from scratch: encoding, tournament selection, order crossover, mutation, elitism, diversity, and budget-matched routing comparisons.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Local Search and Simulated Annealing

Oct 29, 2026·42 min read

Build local search and simulated annealing from scratch on an eight-customer routing instance, then compare them across 20 seeds against the enumerated optimum.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Prediction Intervals and Split Conformal Prediction

Oct 29, 2026·46 min read

Build distribution-free prediction intervals and label sets with split conformal prediction, including finite-sample quantiles and marginal coverage guarantees.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Probability Calibration

Oct 29, 2026·41 min read

Probability calibration for classifiers: reliability diagrams, Brier score, log loss, sigmoid and isotonic recalibration, and practical monitoring.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Random Survival Forests

Oct 29, 2026·69 min read

Build random survival forests from scratch: log-rank splits, Nelson-Aalen leaves, censoring-aware risk sets, OOB scoring, and comparison with Cox models.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratchoperations-research

Objectives, Decision Variables, Constraints, and Feasibility

Oct 29, 2026·48 min read

A production example links objectives, domains, and constraints to feasible plans, LP and integer optima, optimality gaps, and independent audits.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Differential Evolution

Oct 29, 2026·39 min read

Build Differential Evolution from scratch: differential mutation, binomial crossover, greedy selection, bounds, and budget-matched benchmarks on Rastrigin.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Multilayer Perceptrons and Backpropagation

Oct 29, 2026·51 min read

Build a one-hidden-layer multilayer perceptron from scratch: derive forward and backward passes, check gradients, and train with mini-batches.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Gaussian Mixture Models and Expectation-Maximization

Oct 29, 2026·56 min read

Gaussian mixture models cluster with soft assignments. EM derivations and NumPy code explain covariance geometry, stable fitting, and component selection.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Evaluating Survival Predictions

Oct 27, 2026·77 min read

Score censored survival models with concordance and IPCW Brier scores. Learn to compare Cox, Weibull AFT, and Kaplan-Meier forecasts honestly.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Linear and Quadratic Discriminant Analysis

Oct 27, 2026·59 min read

Build LDA and QDA classifiers from Gaussian class models and Bayes' rule, with covariance estimation, shrinkage, and NumPy implementations.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Naive Bayes

Oct 26, 2026·64 min read

Learn how naive Bayes classifiers work: Bayes decision rule, Gaussian and multinomial event models, smoothing, log-sum-exp, and NumPy implementation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

k-Nearest Neighbors

Oct 26, 2026·56 min read

Build kNN from scratch, covering distance metrics, majority voting, local averaging, feature scaling, distance weighting, and the curse of dimensionality.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Cox Proportional Hazards

Oct 26, 2026·57 min read

Learn how the Cox proportional hazards model estimates covariate effects on hazards using partial likelihood, with NumPy implementation and diagnostics.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Support Vector Machines and Support Vector Regression

Oct 26, 2026·50 min read

Learn how support vector machines and support vector regression work, from margins and hinge loss to kernels, dual coefficients, epsilon tubes, and scikit-learn implementation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Kaplan–Meier and Nelson–Aalen Estimation

Oct 26, 2026·39 min read

Learn Kaplan-Meier and Nelson-Aalen estimation for right-censored data, covering risk sets, ties, Greenwood variance, medians, and NumPy implementation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Quantile Regression

Oct 26, 2026·66 min read

Learn quantile regression from first principles: pinball loss, linear programming, conditional quantiles, crossing diagnostics, and Python implementation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Accelerated Failure-Time Models

Oct 26, 2026·44 min read

Learn how AFT models fit censored event-time data, interpret coefficients as time ratios, and compare Weibull and log-normal survival curves.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Time-to-Event Data, Censoring, and Hazard Functions

Oct 25, 2026·46 min read

Learn how survival analysis handles right-censored durations, defines hazard and survival functions, and builds the censored-data likelihood from scratch.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Hyperparameter Search and Nested Cross-Validation

Oct 25, 2026·51 min read

Master hyperparameter search and nested cross-validation. Compare grid and random search, diagnose selection bias, and evaluate tuning procedures honestly.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Validation Strategies and Data Leakage

Oct 25, 2026·47 min read

Learn task-matched validation with grouped, stratified, and temporal splits, out-of-fold predictions, and preprocessing within the training boundary.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Gradient Descent and Numerical Optimization

Oct 25, 2026·43 min read

Learn how gradient descent updates parameters on quadratic objectives, how curvature and learning rates control convergence, and how to verify least-squares fits in NumPy.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Maximum Likelihood Estimation

Oct 25, 2026·51 min read

Learn maximum likelihood estimation from scratch, including Bernoulli and Gaussian estimators, log-likelihood, score, curvature, and NumPy/SciPy implementation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Generalized Additive Models

Oct 25, 2026·45 min read

Learn generalized additive models from scratch: spline bases, difference penalties, link functions, identifiability, cross-validated smoothing, and NumPy fits.

Open notebook
Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Classification Metrics and Decision Thresholds

Oct 24, 2026·68 min read

Learn how confusion matrices, precision, recall, ROC AUC, and average precision guide threshold selection under class imbalance and decision costs in practice.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Frontier Questions and Research Roadmaps

Aug 11, 2026·98 min read

Frontier questions and research roadmaps for world models: generality contracts, causal structure, persistent memory, and decision-relevant evaluation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Sim-to-Real Deployment and Continual Correction

Aug 10, 2026·74 min read

A reproducible sim-to-real workflow covering structural mismatch, domain randomization, delay ablations, residual monitoring, and gated continual correction.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Training and Inference Systems

Aug 9, 2026·56 min read

Distributed training, checkpointing, and stateful rollout serving for world models, with latency, memory, and energy budgets for deployment.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Security, Ethics, Privacy, and Governance

Aug 8, 2026·73 min read

World model security, privacy, and governance: poisoning, extraction, membership leakage, dual-use simulation, documentation, and access control.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Robustness, Calibration, and Safe Control

Aug 7, 2026·58 min read

Stress testing, calibrated uncertainty, risk-sensitive planning, and runtime assurance for safe control with imperfect world models.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Failure Modes and Model Exploitation

Aug 6, 2026·54 min read

World models fail through compounding error, objective misspecification, planner exploitation, state aliasing, forgetting, and hallucinated dynamics.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Interpretability and World-Model Debugging

Aug 5, 2026·62 min read

Probes, TCAV, rollouts, and component substitution show what a world model represents, what its planner uses, and where causal claims remain unsupported.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Datasets, Benchmarks, and Experimental Design

Aug 4, 2026·84 min read

Benchmark selection, leakage checks, ablations, and compute reporting connect world-model claims to reproducible experimental evidence.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Planning, Control, and Policy Evaluation

Aug 3, 2026·51 min read

Evaluate composed model-planner-policy systems through closed-loop return, sample efficiency, planning horizon tradeoffs, exploitation, and transfer protocols.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

State, Physics, Causality, and Memory Evaluation

Aug 2, 2026·62 min read

Test world-model state, physics, causality, and memory with probes, occlusion, energy checks, and paired interventions; learn what each diagnostic can prove.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Perceptual and Generative Evaluation

Aug 1, 2026·62 min read

Score predicted observations with MSE, PSNR, SSIM, LPIPS, FID, and FVD. Protocols, conditioning, best-of-K, and human judgment shape the results.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

The World-Model Evaluation Ladder

Jul 31, 2026·41 min read

World-model evaluation uses a five-rung ladder covering one-step prediction, open-loop rollout, intervention, closed-loop planning, and transfer.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Scientific, Medical, and Social Worlds

Jul 30, 2026·60 min read

Scientific, medical, and social world models connect prediction, simulation, and counterfactual inference under uncertainty and domain constraints.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Digital and Software Environments

Jul 29, 2026·44 min read

Model web, desktop, and code-execution state as partial observations, then verify actions, correct beliefs, and separate prediction error from task success.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Autonomous Driving

Jul 28, 2026·56 min read

Examine driving world models through bird's-eye-view and occupancy state, other-agent prediction, closed-loop simulation, and rare-event safety planning.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Locomotion, Humanoids, and Navigation

Jul 27, 2026·66 min read

Model legged locomotion, whole-body control, and map-based navigation with hybrid contact dynamics, terrain uncertainty, and sim-to-real transfer.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Robotic Manipulation

Jul 26, 2026·42 min read

Build a miniature planar pushing world model in Python: contact features, Ridge regressors, rollout error, random-shooting plans, and affordance maps.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Games and Learned Game Engines

Jul 25, 2026·43 min read

Compare Atari, board games, and open worlds as learned game engines. Measure one-step prediction, recursive rollout drift, and model-predictive control.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Vision-Language-Action and World-Action Models

Jul 24, 2026·76 min read

VLA and world-action models fuse vision, language, and control, tokenize robot actions, and transfer across embodiments under closed-loop evaluation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Cosmos and Omnimodal World Foundation Models

Jul 23, 2026·67 min read

Examines NVIDIA's Cosmos world foundation models: video tokenization, physical AI data curation, conditional generation, guidance calibration, and simulation.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Genie and Interactive Generated Environments

Jul 22, 2026·54 min read

Genie discovers latent actions from unlabeled video and builds interactive generated environments, with tests for control, rollout, and persistence.

Open notebook
Data, Analytics & AISoftware EngineeringMachine Learningworld-models-handbook

Video Generators as Candidate World Models

Jul 21, 2026·47 min read

Can video generators serve as world models? Tests cover action-conditioned prediction, a qualification ladder, occlusion memory, and closed-loop planning.

Open notebook
Community

Learn with the community

Create a free account to keep your reading organized, join thoughtful discussions, and get more from every chapter.

  • Keep your place across books and articles
  • Ask questions and take part in discussions
  • Read with fewer interruptions

Free to join · Takes less than a minute

Why

I created this space so readers can learn together, ask questions, and make sense of difficult ideas.

Michael Brenndoerfer
From readers1 / 12