Mathematical Reasoning › Symbolic Integration: A Case Study

Symbolic integration is an instructive case study in the limits of LLM mathematical reasoning. Integration is a core calculus operation, and human-designed algorithms for symbolic integration (like the Risch algorithm) are complete for a large class of functions. Yet LLMs struggle significantly with non-trivial integrals.

Consider the integral:

$$\int x e^{x^2} \, dx$$

The correct approach requires recognizing that $e^{x^2}$ is not directly integrable, but noticing that the presence of $x$ as a multiplicative factor suggests the substitution $u = x^2$, giving $du = 2x \, dx$. We apply the substitution step by step:

$$\begin{aligned} \int x e^{x^2} \, dx &= \int x \cdot e^u \cdot \frac{du}{2x} && \text{(substitute } u = x^2,\; du = 2x\,dx \text{)} \\ &= \frac{1}{2} \int e^u \, du && \text{(cancel } x,\text{ factor constant)} \\ &= \frac{1}{2} e^u + C && \text{(integrate exponential)} \\ &= \frac{1}{2} e^{x^2} + C && \text{(substitute back } u = x^2 \text{)} \end{aligned}$$

A model that has memorized the pattern "$x e^{ax^2}$ integrates to $\frac{1}{2a} e^{ax^2}$" might get this correct by template matching. A model that understands substitution will also succeed on variants like $\int x^3 e^{x^4} \, dx$. The benchmark challenge is designing problems that distinguish these cases.

The contrast with traditional computer algebra systems is stark. SymPy can evaluate the integral above correctly using algorithmic methods. It does not need to have seen this exact integral before. The Risch algorithm provides a decision procedure for elementary functions: if the integral has a closed form in terms of elementary functions, the algorithm will find it; if it does not, the algorithm will prove that no such form exists. LLMs have no analog of this decision procedure.

Liao et al. (2024) found that frontier LLMs perform well on "simple" symbolic integrals that appear frequently in textbooks but fail systematically on integrals requiring creative substitution or special techniques. This suggests that current mathematical capability is heavily influenced by the distribution of training examples rather than principled mathematical understanding.

The practical upshot is that for symbolic computation tasks, a hybrid approach outperforms either pure LLM or pure CAS. The LLM excels at understanding problem context, translating verbal descriptions into formal expressions, and selecting which technique to apply. The CAS executes the technique correctly. Combining them produces a system that is both flexible (handles novel phrasings and problem structures) and precise (guaranteed correct computation).