LLM and GenAI

Articles about Large Language Models and Generative AI, exploring their architectures, training methods, and real-world applications.

32 items

Community

Learn with the community

Create a free account to keep your reading organized, join thoughtful discussions, and get more from every chapter.

  • Keep your place across books and articles
  • Ask questions and take part in discussions
  • Read with fewer interruptions

Free to join · Takes less than a minute

Why

I created this space so readers can learn together, ask questions, and make sense of difficult ideas.

Michael Brenndoerfer
From readers1 / 12
Data, Analytics & AISoftware EngineeringLLM and GenAI

Building AI Agents with LangChain and LangGraph: Part 2

Aug 2, 2025·14 min read

Build agentic workflows with LangChain and LangGraph using state graphs, tool routing, persistence, retries, and multi-step control.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Foundation Models Report: Defining a New Paradigm in AI

Jul 29, 2025·17 min read

Covers the 2021 Foundation Models Report published by Stanford's CRFM. Explains how this influential report formally defined foundation models.

Open notebook
Data, Analytics & AISoftware EngineeringLLM and GenAI

The Mathematics Behind LLM Fine-Tuning

Jul 28, 2025·13 min read

Covers the mathematical foundations of LLM fine-tuning with clear explanations and minimal prerequisites.

Read article
Data, Analytics & AISoftware EngineeringLLM and GenAI

Adapting LLMs: Context Injection vs. Fine-Tuning

Jul 22, 2025·15 min read

Covers choosing the right approach for your LLM project: using pre-trained models as-is, enhancing them with context injection and RAG.

Read article
Data, Analytics & AISoftware EngineeringLLM and GenAI

Building AI Agents with LangChain and LangGraph: Part 1

Jul 21, 2025·6 min read

Covers the core concepts of LLM workflows: connecting language models to tools, handling responses, and building intelligent systems.

Open notebook
History of Language AIMachine LearningData, Analytics & AILLM and GenAI

Dense Passage Retrieval and Retrieval-Augmented Generation

Jul 21, 2025·18 min read

Covers Dense Passage Retrieval (DPR) and Retrieval-Augmented Generation (RAG), the 2020 innovations.

Open notebook
Data, Analytics & AISoftware EngineeringLLM and GenAI

What are AI Agents, Really?

May 27, 2025·10 min read

AI agents combine a language model with tools, memory, and control logic. This article separates agents from workflows and multi-agent systems.

Read article
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Deep Learning for Speech Recognition: The 2012 DNN Results

May 24, 2025·13 min read

The application of deep neural networks to speech recognition in 2012, led by Geoffrey Hinton and his colleagues, marked a major advance.

Open notebook
Data, Analytics & AISoftware EngineeringLLM and GenAI

Model Context Protocol (MCP) for LLM Tool Integration

May 22, 2025·6 min read

Model Context Protocol (MCP) gives LLM applications a standard way to list tools, call them, and exchange structured results across services.

Read article
Data, Analytics & AISoftware EngineeringLLM and GenAI

Why Temperature=0 Doesn't Guarantee Determinism in LLMs

May 18, 2025·12 min read

Temperature zero does not make an LLM deterministic. GPU kernels, batching, floating-point arithmetic, and serving choices can still change its output.

Read article
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

WaveNet: Neural Audio Generation Revolution

May 12, 2025·16 min read

DeepMind's WaveNet changed text-to-speech synthesis in 2016 by generating raw audio waveforms directly using neural networks.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

PropBank: Semantic Role Labeling and Proposition Bank

May 2, 2025·20 min read

In 2005, the PropBank project at the University of Pennsylvania added semantic role labels to the Penn Treebank.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

FrameNet: A Computational Resource for Frame Semantics

Apr 24, 2025·25 min read

In 1998, Charles Fillmore's FrameNet project at ICSI Berkeley released the first large-scale computational resource based on frame semantics.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

BLEU Metric: Automatic Evaluation for Machine Translation

Mar 31, 2025·23 min read

In 2002, IBM researchers introduced BLEU (Bilingual Evaluation Understudy), revolutionizing machine translation evaluation.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Conditional Random Fields: History CRF

Mar 29, 2025·24 min read

Conditional Random Fields model structured predictions without assuming independent labels. Covers the 2001 paper, feature design, inference, and later uses.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

From Symbolic Rules to Statistical Learning

Mar 27, 2025·21 min read

Natural language processing underwent a fundamental shift from symbolic rules to statistical learning.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Shannon's N-gram Model

Mar 25, 2025·13 min read

Claude Shannon's 1948 work on information theory introduced n-gram models, one of the most core concepts in natural language processing.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

The Turing Test: Imitation and Machine Intelligence

Mar 23, 2025·14 min read

In 1950, Alan Turing proposed a deceptively simple test for machine intelligence, originally called the Imitation Game.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

ELIZA: The First Conversational AI Program

Mar 21, 2025·14 min read

Joseph Weizenbaum's ELIZA, created in 1966, became the first computer program to hold something resembling a conversation.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Hidden Markov Models: Statistical Speech Recognition

Mar 19, 2025·22 min read

Hidden Markov Models changed speech recognition in the 1970s by introducing a clever probabilistic approach.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

The Perceptron: Foundation of Modern Neural Networks

Mar 17, 2025·25 min read

In 1958, Frank Rosenblatt created the perceptron at Cornell Aeronautical Laboratory, the first artificial neural network.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

SHRDLU: Understanding Language Through Action

Mar 15, 2025·10 min read

In 1968, Terry Winograd's SHRDLU system demonstrated a major approach to natural language understanding by grounding language in a simulated blocks world.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

MADALINE: Multiple Adaptive Linear Neural Networks

Mar 13, 2025·29 min read

Bernard Widrow and Marcian Hoff built MADALINE at Stanford in 1962, taking neural networks beyond the perceptron's limitations.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

IBM Statistical Machine Translation: From Rules to Data

Mar 11, 2025·21 min read

In 1991, IBM researchers changed machine translation by introducing the first broad statistical approach.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Recurrent Neural Networks: Machines That Remember

Mar 9, 2025·23 min read

In 1995, RNNs changed sequence processing by introducing neural networks with memory: connections.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Long Short-Term Memory: Solving the Memory Problem

Mar 7, 2025·32 min read

Hochreiter and Schmidhuber introduced LSTMs in 1997 to address vanishing gradients. Covers gated memory, long context, and later sequence models.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Backpropagation: Training Deep Neural Networks

Mar 5, 2025·26 min read

In the 1980s, neural networks hit a wall: nobody knew how to train deep models. That changed when Rumelhart, Hinton.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

WordNet: A Semantic Network for Language Understanding

Mar 3, 2025·32 min read

In the mid-1990s, Princeton University released WordNet, a major lexical database.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Convolutional Neural Networks

Mar 1, 2025·20 min read

In 1988, Yann LeCun introduced Convolutional Neural Networks at Bell Labs, forever changing how machines process visual information.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Katz Back-off: Handling Sparse Data in Language Models

Feb 27, 2025·16 min read

In 1987, Slava Katz solved one of statistical language modeling's biggest problems. When your model encounters word sequences it has never seen before.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

Time Delay Neural Networks

Feb 25, 2025·22 min read

In 1987, Alex Waibel introduced Time Delay Neural Networks, a major architecture that changed how neural networks process sequential data.

Open notebook
Data, Analytics & AIMachine LearningLLM and GenAIHistory of Language AI

ROUGE and METEOR Evaluation Metrics

Feb 17, 2025·12 min read

In 2004, ROUGE and METEOR addressed critical limitations in BLEU's evaluation approach.

Open notebook
Community

Learn with the community

Create a free account to keep your reading organized, join thoughtful discussions, and get more from every chapter.

  • Keep your place across books and articles
  • Ask questions and take part in discussions
  • Read with fewer interruptions

Free to join · Takes less than a minute

Why

I created this space so readers can learn together, ask questions, and make sense of difficult ideas.

Michael Brenndoerfer
From readers1 / 12