Data, Analytics & AI Articles – Page 11

Michael Brenndoerfer

Data, Analytics & AI

Articles about data, analytics, and AI, including machine learning, data visualization, and AI applications.

702 items · Page 11 of 15

Community

Learn with the community

Create a free account to keep your reading organized, join thoughtful discussions, and get more from every chapter.

Keep your place across books and articles
Ask questions and take part in discussions
Read with fewer interruptions

Join the community

Free to join · Takes less than a minute

Why

I created this space so readers can learn together, ask questions, and make sense of difficult ideas.

From readers1 / 12

Data, Analytics & AILanguage AI HandbookMachine Learning

Linear Attention: Breaking the Quadratic Bottleneck

Jun 25, 2025·42 min read

Explains how linear attention achieves O(nd²) complexity by replacing softmax with kernel functions.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningHistory of Language AI

T5 and Text-to-Text Framework

Jun 25, 2025·19 min read

Covers Google's T5 (Text-to-Text Transfer Transformer) introduced in 2019. Explains how the text-to-text framework unified diverse NLP tasks.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

Sliding Window Attention

Jun 24, 2025·43 min read

Explains how sliding window attention reduces transformer complexity from quadratic to linear.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Logistic Regression: Math & Python

Jun 24, 2025·46 min read

Covers logistic regression covering mathematical foundations, the logistic function, optimization algorithms, and practical implementation.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningLanguage AI Handbook

Longformer: Efficient Attention for Long Documents

Jun 23, 2025·55 min read

Explains how Longformer combines sliding window and global attention to process documents of 4,096+ tokens with O(n) complexity instead of O(n²).

Open notebook

History of Language AIMachine LearningData, Analytics & AI

GLUE and SuperGLUE: Language Understanding Benchmarks

Jun 23, 2025·19 min read

Covers GLUE and SuperGLUE benchmarks introduced in 2018. Explains how these standardized evaluation frameworks changed language AI research.

Open notebook

AI Agent HandbookMachine LearningData, Analytics & AI

Why AI Agents Need Tools Beyond Language Models

Jun 23, 2025·10 min read

Explains why AI agents need external tools to overcome limitations like outdated knowledge, imprecise calculations, and inability to take real-world actions.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningLanguage AI Handbook

Sparse Attention Patterns: Local, Strided

Jun 22, 2025·61 min read

Implement sparse attention patterns including local windows, strided attention, and block-sparse methods.

Open notebook

Data, Analytics & AILanguage AI HandbookMachine Learning

BigBird: Sparse Attention

Jun 21, 2025·40 min read

BigBird combines sliding-window, global, and random attention to reach linear complexity. Covers its guarantees and use with long documents.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Poisson Regression: Count Data Modeling with Math & Python

Jun 21, 2025·49 min read

Covers Poisson regression for count data analysis. Topics include mathematical foundations, maximum likelihood estimation, rate ratio interpretation.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningHistory of Language AI

Transformer-XL: Extending Transformers to Long Sequences

Jun 21, 2025·6 min read

Transformer-XL extends context with segment recurrence and relative positions. Covers its architecture, efficiency, training method, and influence.

Open notebook

Data, Analytics & AIMachine LearningAI Agent Handbook

Chain-of-Thought Reasoning for AI Agents

Jun 21, 2025·16 min read

Use chain-of-thought prompting to get AI agents to reason through problems step by step, improving accuracy and transparency for complex questions.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

Global Tokens for Long-Range Attention

Jun 20, 2025·51 min read

Global tokens create communication hubs in sparse attention, reducing path length and helping efficient transformers exchange information across long documents.

Open notebook

Data, Analytics & AILanguage AI HandbookMachine Learning

Quadratic Attention Bottleneck

Jun 19, 2025·48 min read

Explains why self-attention has O(n²) complexity, how memory and compute scale quadratically with sequence length.

Open notebook

History of Language AIMachine LearningData, Analytics & AI

BERT for Search: Transformer Ranking and Semantic Retrieval

Jun 19, 2025·19 min read

Covers BERT's application to information retrieval in 2019. Explains how transformer architectures changed search and ranking systems.

Open notebook

AI Agent HandbookMachine LearningData, Analytics & AI

Checking and Refining Agent Reasoning

Jun 19, 2025·16 min read

Guide AI agents to verify and refine their reasoning through self-checking techniques. Topics include practical methods for catching errors, improving accuracy.

Open notebook

Data, Analytics & AILanguage AI HandbookMachine Learning

Encoder-Decoder Architecture: Cross-Attention

Jun 18, 2025·42 min read

Covers encoder-decoder transformer architecture that powers T5 and machine translation. Topics include cross-attention mechanism.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Spline Regression: Non-Linear Modeling with Math & Python

Jun 18, 2025·65 min read

Spline regression models nonlinear relationships with piecewise polynomials. Covers B-splines, knot selection, natural cubic splines, and Python.

Open notebook

Data, Analytics & AILanguage AI HandbookMachine Learning

Decoder Architecture: Causal Masking

Jun 17, 2025·38 min read

Covers decoder-only transformers powering GPT, Llama, and modern LLMs. Topics include causal masking, autoregressive generation, KV caching.

Open notebook

History of Language AIMachine LearningData, Analytics & AI

ELMo and ULMFiT: Transfer Learning for NLP

Jun 17, 2025·20 min read

Covers ELMo and ULMFiT, the advance methods that established transfer learning for NLP in 2018.

Open notebook

AI Agent HandbookMachine LearningData, Analytics & AI

Step-by-Step Problem Solving

Jun 17, 2025·15 min read

Teach AI agents to think through problems step by step using chain-of-thought reasoning.

Open notebook

Data, Analytics & AILanguage AI HandbookMachine Learning

Transformer Architecture Hyperparameters: Depth, Width

Jun 16, 2025·39 min read

Design transformer architectures by understanding the key hyperparameters: model depth, width, attention heads, and FFN dimensions.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

Cross-Attention: Connecting Encoder and Decoder

Jun 15, 2025·59 min read

Covers cross-attention, the mechanism that bridges encoder and decoder in sequence-to-sequence transformers.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Multinomial Logistic Regression: Math & Python

Jun 15, 2025·48 min read

Covers multinomial logistic regression covering mathematical foundations, softmax function, coefficient estimation.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningHistory of Language AI

GPT-1 and GPT-2: Autoregressive Transfer Learning

Jun 15, 2025·18 min read

Covers OpenAI's GPT-1 and GPT-2 models. Explains how autoregressive pretraining with transformers enabled transfer learning across NLP tasks.

Open notebook

AI Agent HandbookMachine LearningData, Analytics & AI

Prompting: Writing Effective Instructions for AI Agents

Jun 15, 2025·8 min read

Covers art of communicating with AI agents through effective prompting. Craft clear instructions, use roles and examples.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

Weight Tying in Transformer Embeddings

Jun 14, 2025·53 min read

Explains how weight tying reduces transformer parameters by sharing the input embedding and output projection matrices.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

Encoder Architecture

Jun 13, 2025·45 min read

Explains how encoder-only transformers like BERT use bidirectional self-attention for text understanding.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningHistory of Language AI

BERT: Bidirectional Pretraining for Language Understanding

Jun 13, 2025·15 min read

Covers BERT (Bidirectional Encoder Representations from Transformers), including masked language modeling, bidirectional context understanding.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

Gated Linear Units: The FFN Architecture Behind Modern LLMs

Jun 12, 2025·44 min read

Explains how GLUs transform feed-forward networks through multiplicative gating. Topics include SwiGLU, GeGLU, and the parameter trade-offs that power LLaMA.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Elastic Net Regularization: Math & Python

Jun 12, 2025·52 min read

Covers Elastic Net regularization, including mathematical foundations, geometric interpretation.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

FFN Activation Functions: ReLU, GELU

Jun 11, 2025·52 min read

Compare activation functions in transformer feed-forward networks: ReLU's simplicity and dead neuron problem, GELU's smooth probabilistic gating for BERT.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningHistory of Language AI

XLNet, RoBERTa, ALBERT

Jun 11, 2025·17 min read

Explains how XLNet, RoBERTa, and ALBERT refined BERT through permutation language modeling, optimized training procedures, and architectural efficiency.

Open notebook

AI Agent HandbookMachine LearningData, Analytics & AI

Crafting Clear Instructions

Jun 11, 2025·10 min read

Covers the fundamentals of writing effective prompts for AI agents. Explains how to be specific, provide context.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

Transformer Blocks: Encoder and Decoder Assembly

Jun 10, 2025·44 min read

Assemble transformer blocks by combining residual connections, normalization, attention, and feed-forward networks.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningLanguage AI Handbook

Layer Normalization: Stabilizing Transformer Training

Jun 9, 2025·52 min read

Explains how layer normalization enables stable transformer training by normalizing.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch

Polynomial Regression: Math and Python Implementation

Jun 9, 2025·38 min read

Model nonlinear relationships with polynomial regression. Covers feature construction, Python implementation, model selection, bias, variance, and overfitting.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningHistory of Language AI

RLHF Foundations: Learning from Human Preferences in RL

Jun 9, 2025·13 min read

Covers preference-based learning, the framework developed by Christiano et al. in 2017.

Open notebook

AI Agent HandbookMachine LearningData, Analytics & AI

Language Models as the Core of AI Agents

Jun 9, 2025·4 min read

Language models are the reasoning core of many AI agents. Covers token prediction, instruction following, tool selection, and limits of model-only systems.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

Feed-Forward Networks in Transformers: Architecture

Jun 8, 2025·56 min read

Explains how feed-forward networks provide nonlinearity in transformers, with 2-layer architecture, 4x dimension expansion, parameter analysis.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

Pre-Norm vs Post-Norm

Jun 7, 2025·46 min read

Compare pre-norm and post-norm transformer blocks. Covers layer-normalization placement, gradient flow, training stability, and model depth.

Open notebook

History of Language AIMachine LearningData, Analytics & AI

The Transformer: Attention Is All You Need

Jun 7, 2025·20 min read

Covers the Transformer architecture, including self-attention mechanisms, multi-head attention, positional encodings.

Open notebook

Data, Analytics & AIMachine LearningLanguage AI Handbook

Residual Connections and Gradient Flow in Transformers

Jun 6, 2025·46 min read

Explains how residual connections solve the vanishing gradient problem in deep networks. Topics include the math behind skip connections, gradient highways.

Open notebook

Data, Analytics & AISoftware EngineeringMachine LearningMachine Learning from Scratch