Responsible, Secure, and Interpretable Language AI
For teams responsible for fairness, model understanding, safety, agent security, audits, and governance.
Part of Language AI Handbook. The online chapters are free to read; the PDF edition is yours to keep, with future updates included.
Become a more confident language AI practitioner.
Build the understanding to explain how language models work and make more informed choices about using them. The handbook connects the foundations to the methods behind modern language AI, with explanations you can return to as you learn.
See what you’ll learnWhat you will learn
- Understand Bias and Fairness.
- Understand Interpretability.
- Understand Safety and Security.
- Understand Agentic AI and Protocol Security.
- Understand Human-AI Interaction and Governance.
Who this volume is for
- Engineers, researchers, students, AI enthusiasts, linguists, product managers, and anyone interested in understanding or building modern language AI systems, from foundational NLP to advanced large language models.
Prerequisites: Assumes model fundamentals and benefits from Volume 18's evaluation framework.
Volume 19 PDF edition
Own this 760-page edition
Keep the PDF for offline reading, with future updates included. The corresponding chapters stay free online.
- Carefully typeset PDF
- Future updates and errata included
- Online chapters remain free to read
Volume 19 of 20 · In progress
$24
one-timeVersion 2026.08.0 · 760 pages · secure checkout via Stripe
Delivered by email · Free updates included
Want the complete library?
Access to every volume, delivered as separate PDFs. Save $257 vs. buying available volumes separately.
Get all-volume access · $199Reader verdict
5.0
out of 5
12 five-star reader reviews
Genuine feedback, with names abbreviated for privacy.
Meet the community“Really appreciate the way you have explained the concepts. Simple to understand, yet builds up knowledge exponentially, all while reinforcing it with examples repeatedly. I've read the last two chapters `74.Self-attention & 75.Q,K,V` and I've to admit, my concepts have never been clearer. You really are doing an amazing job breaking down maths and complex concepts like a story!”
“I would like to thank you for your work. Specifically, the chapter: 'LIME Explainability: Complete Guide to Local Interpretable Model-Agnostic Explanations' was extremely helpful for me in understanding LIME and communicating to colleagues. Your work is inspiring and valuable. Thank you for doing it.”
“I am enjoying reading your writings. I appreciate the effort you put into it. I want to drop a note of thanks. Thank you!”
“Your writing feels like a treasure trove of great material. So, thank you for compiling everything on your website!”
“I found your book Language AI Handbook's explanations of Transformer architectures and production deployment strategies to be exceptionally clear and insightful”
“Thanks so much for establishing such an amazing community. I appreciate the opportunity to be a learner and a contributor to the community.”
“Thank you Michael. It's top!”
“I came across your collection of online handbooks covering quantitative finance, AI, and machine learning. I wanted to reach out and thank you for making such high-quality material openly available. They are incredibly helpful for my CFA Level II review and for brushing up ahead of ML interviews.”
“I came across one of your books, Language AI Handbook, and man, I'm loving it. I've read many books but have never found such a comprehensive book on large models that covers everything from start to finish with such depth.”
“I just came across your website where your books are available for free to read. Thank you so much for making this available to the public. This will help a lot of people.”
“Thanks for putting cool stuff out into the world.”
“I read a few of your blogs on NLP and oh WOW, they really are something, now I exactly know how all of the terms Entropy, Cross-entropy and how it is connected to Perplexity, will definitely read more of your blogs.”
Read all 12 reader reviews
“I would like to thank you for your work. Specifically, the chapter: 'LIME Explainability: Complete Guide to Local Interpretable Model-Agnostic Explanations' was extremely helpful for me in understanding LIME and communicating to colleagues. Your work is inspiring and valuable. Thank you for doing it.”
“Really appreciate the way you have explained the concepts. Simple to understand, yet builds up knowledge exponentially, all while reinforcing it with examples repeatedly. I've read the last two chapters `74.Self-attention & 75.Q,K,V` and I've to admit, my concepts have never been clearer. You really are doing an amazing job breaking down maths and complex concepts like a story!”
“Thanks so much for establishing such an amazing community. I appreciate the opportunity to be a learner and a contributor to the community.”
“I just came across your website where your books are available for free to read. Thank you so much for making this available to the public. This will help a lot of people.”
“I am enjoying reading your writings. I appreciate the effort you put into it. I want to drop a note of thanks. Thank you!”
“Thank you Michael. It's top!”
“Thanks for putting cool stuff out into the world.”
“I found your book Language AI Handbook's explanations of Transformer architectures and production deployment strategies to be exceptionally clear and insightful”
“Your writing feels like a treasure trove of great material. So, thank you for compiling everything on your website!”
“I came across your collection of online handbooks covering quantitative finance, AI, and machine learning. I wanted to reach out and thank you for making such high-quality material openly available. They are incredibly helpful for my CFA Level II review and for brushing up ahead of ML interviews.”
“I read a few of your blogs on NLP and oh WOW, they really are something, now I exactly know how all of the terms Entropy, Cross-entropy and how it is connected to Perplexity, will definitely read more of your blogs.”
“I came across one of your books, Language AI Handbook, and man, I'm loving it. I've read many books but have never found such a comprehensive book on large models that covers everything from start to finish with such depth.”
Exact contents
24 chapters across 5 parts
Every linked chapter is free to read online. 13 further chapters are planned; unlinked titles are still in progress.
Part LVIII: Bias and Fairness
- 01Bias in Language Models
Covers bias sources, bias types (demographic, cultural), bias in training data, bias amplification.
- 02Bias Measurement
Covers embedding association tests, generation bias metrics, classification bias metrics, bias benchmarks.
- 03Bias Mitigation: Debiasing, CDA, and Fair Fine-tuning
Practical techniques for reducing demographic bias in language models: data balancing, embedding debiasing, adversarial training, and prompt-based interventions.
- 04Fairness Metrics: Demographic Parity, Equalized Odds, and Trade-offs
Learn the key mathematical definitions of algorithmic fairness, from demographic parity to equalized odds, and why satisfying all metrics simultaneously is impossible.
- 05Representation Harms
Covers stereotyping, erasure, demeaning associations, measuring representation harms.
Part LIX: Interpretability
- 01Interpretability Goals
Covers debugging, trust, safety, scientific understanding, interpretability approaches overview.
- 02Attention Visualization
Covers attention weight extraction, attention head visualization, attention interpretation caveats, attention tools.
- 03Attention Analysis Limitations
Covers attention vs importance, attention manipulation studies, gradient-based alternatives.
- 04Probing Classifiers
Covers linear probing methodology, probing task design, probing interpretation, control tasks.
- 05Probing Layers
Covers layer selection, representation evolution, task localization, layer probing patterns.
- 06Activation Patching
Covers patching methodology, locating information, patching experiments, causal tracing.
- 07Logit Lens
Covers logit lens concept, intermediate vocabulary projection, tuned lens, lens interpretation.
- 08Sparse Autoencoders
Covers SAE architecture, sparsity constraints, dictionary learning, SAE for LLMs.
- 09Feature Interpretation
Covers feature activation patterns, feature naming, automated interpretation, feature circuits.
- 10Mechanistic Interpretability
Reverse-engineer transformer networks into human-understandable algorithms by identifying circuits, induction heads, and mechanistic discoveries.
- 11Activation Steering: Steering Vectors and Representation Engineering
Learn how steering vectors and activation addition let you modify language model behavior at inference time by injecting directional nudges into the residual stream.
Part LX: Safety and Security
- 01Safety Risks
Covers harmful content generation, misuse scenarios, unintended harms, safety threat models.
- 02Red Teaming
Learn how red teams systematically probe language models for safety failures, covering attack taxonomies, ASR metrics, RL-based automated attack generation, and real-world findings.
- 03Jailbreaking
Covers jailbreak techniques, prompt injection, adversarial suffixes, jailbreak defenses.
- 04Prompt Injection
Covers direct prompt injection, indirect prompt injection, injection in RAG, injection defenses.
- 05Content Filtering
Covers classification-based filtering, rule-based filtering, filter placement, filter evaluation.
- 06Guardrails
Covers input guardrails, output guardrails, guardrail frameworks, guardrail design.
- 07Memorization and Privacy in Language Models
How language models memorize training data, methods for measuring extractable memorization, PII risks in web-scale corpora, and practical privacy mitigations.
- 08Differential Privacy
Learn how differential privacy protects training data in language models, from the mathematical guarantee to DP-SGD, privacy budgets, and practical LLM fine-tuning.
Part LXI: Agentic AI and Protocol Security
- 01Threat Modeling Compound AI Systems · In progress
Assets, actors, trust boundaries, control flow, data flow, and failure propagation across model-centered systems.
- 02Indirect Prompt Injection · In progress
Malicious instructions in documents, web pages, messages, tool output, and retrieved context.
- 03Tool, Retrieval, and Memory Poisoning · In progress
Schema attacks, compromised tools, poisoned indexes, persistent memory attacks, and integrity controls.
- 04Identity, Authorization, and Least Privilege · In progress
User and agent identity, scoped credentials, delegation, expiry, consent, and policy enforcement outside the model.
- 05Secrets, Sandboxes, and Safe Execution · In progress
Credential isolation, capability sandboxes, network and filesystem boundaries, output validation, and containment.
- 06Agent Supply Chains and Protocol Security · In progress
Tool registries, dependency tampering, server discovery, trust-on-first-use, signing, and update risk.
- 07Audit, Detection, and Incident Response · In progress
Tamper-evident traces, anomaly detection, kill switches, investigation, rollback, and post-incident learning.
Part LXII: Human-AI Interaction and Governance
- 01Designing Human-AI Collaboration · In progress
Task allocation, mixed initiative, handoffs, feedback, shared context, and preserving human agency.
- 02Trust, Reliance, and Automation Bias · In progress
Calibrated reliance, overtrust, undertrust, explanations, uncertainty, and behavior under time pressure.
- 03Oversight, Appeals, and Escalation · In progress
Review queues, contestability, escalation paths, documentation, and accountability for consequential decisions.
- 04Accessibility and Inclusive Language AI · In progress
Disability access, literacy, language inclusion, participatory design, and evaluating who benefits or is excluded.
- 05System Cards, Audits, and Impact Assessments · In progress
Documenting complete systems, evaluating downstream use, independent audits, and monitoring material changes.
- 06Risk Governance Across the Lifecycle · In progress
Ownership, risk tiers, review gates, incident reporting, change management, and retirement.
Choose the edition that fits your next step
Volume 19: Responsible, Secure, and Interpretable Language AI
760 pages focused on this subject, with future updates included.
$24
Choose this volumeThe complete Language AI Handbook library
All-volume access with separate volume PDFs and future updates. No combined PDF. Includes future volumes as they become available.
$199
Get all-volume accessExplore the other volumes
Volume 1 · 570 pages
Language Data and Classical NLP
Text as Data · Classical Text Representations · Distributional Semantics
Volume 2 · 790 pages
Embeddings, Tokenization, and Sequence Labeling
Word Embeddings · Subword Tokenization · Sequence Labeling
Volume 3 · Coming soon
Linguistic Structure and Meaning
Morphology · Syntax · Semantics · Discourse · Dialogue
Volume 4 · 920 pages
Neural NLP and Sequence Models
Neural Network Foundations · Recurrent Neural Networks · Sequence-to-Sequence
Volume 5 · 860 pages
Transformers from First Principles
Self-Attention · Positional Encoding · Transformer Blocks · Transformer Architectures
Volume 6 · 510 pages
Efficient, Long-Context, and Alternative Architectures
Efficient Attention · Long Context
Volume 7 · 760 pages
Pre-training Data and Scaling
Data Curation · Pre-training Objectives · Scaling Laws
Volume 8 · 440 pages
Encoder, Multilingual, and Translation Models
BERT and Variants · Encoder-Decoder Models
Volume 9 · 730 pages
Decoder Language Models and Capabilities
GPT Architecture · Modern Decoder Models · Emergent Capabilities
Volume 10 · 920 pages
Large-Scale Training and Sparse Models
Training Infrastructure · Training Optimization · Mixture of Experts
Volume 11 · 730 pages
Fine-tuning and Efficient Adaptation
Fine-tuning Fundamentals · Parameter-Efficient Fine-tuning · Instruction Tuning
Volume 12 · 510 pages
Alignment, Preferences, and Oversight
Alignment and RLHF
Volume 13 · 220 pages
Reasoning and Verifiable Learning
Reasoning
Volume 14 · 640 pages
Efficient Inference and On-Device Models
Model Compression · Inference Optimization
Volume 15 · 600 pages
Retrieval, Knowledge, and Memory
Retrieval-Augmented Generation · Continual Learning
Volume 16 · 510 pages
Agents and AI Coding Systems
Code Generation · Tool Use and Agents
Volume 17 · 540 pages
Speech, Multimodal, and Embodied Language
Multimodal Models · Speech and Audio
Volume 18 · 950 pages
Evaluation, Factuality, and Reliability
Evaluation Fundamentals · Benchmark Evaluation · Human and Model Evaluation · Hallucination and Factuality
Volume 20 · 510 pages
Applications, Production, and Compound AI Systems
LLM Applications · Production Systems
Author and edition details
About the author and this edition
Michael Brenndoerfer
Michael has spent more than a decade working across software engineering, data, AI, and business. He writes to understand difficult ideas more deeply and to share what he learns in a clear, practical way.
- Edition
- First edition
- Published
- Last reviewed
Version history
Kept current, not frozen in time
Library access includes every future volume and update. When a volume changes, its updated PDF appears in My books at no extra cost.
Current release
Edition 2026.08.0
Initial volume-library release with 19 written PDFs, a Volume 3 placeholder, and no combined edition.