Term Frequency › Augmented Term Frequency

A clever variant designed specifically to address length bias without discarding frequency information is augmented term frequency. Instead of normalizing by total document length, it normalizes each term's count by the count of the most frequent term in the same document:

where:

• $K \in [0, 1]$: a floor parameter, typically set to 0.5, that controls the minimum weight given to any present term
• $\text{count}(t, d)$: the raw count of term $t$ in document $d$
• $\max_{t'} \text{count}(t', d)$: the count of the most frequent term in document $d$, used as a normalizing constant

The result always lies in $[K, 1]$:

• The most frequent term in any document always receives weight exactly 1.
• A term appearing half as often as the most frequent term receives weight $K + (1-K) \cdot 0.5 = 0.75$ when $K=0.5$.
• Terms with very low counts receive weight close to $K$.
• Absent terms (count = 0) are excluded from the representation and their entries remain 0.

Why the floor $K$? Without the floor, a term appearing once while the maximum count is 1000 would receive near-zero weight ($\approx 0.001$), effectively being treated as absent. The floor $K = 0.5$ ensures that even rare terms receive at least half the weight of the most frequent term, preventing the representation from being dominated entirely by the top few terms. The choice $K = 0.5$ is conventional but not universal; smaller $K$ values give more relative weight to the most frequent term, while larger $K$ values compress all present terms closer together.

Why max normalization instead of total-length normalization? Normalizing by the maximum count within the document makes the representation document-length invariant in an intuitive way: what matters is not how many times you said "climate" in absolute terms, but how often you said "climate" relative to whatever you talked about most. This is particularly useful in authorship attribution and stylometric analysis, where the relative usage patterns of words reveal more about an author's style than absolute counts. Two authors writing on the same topic for the same publication might produce documents of similar length, but their stylistic choices about how often to repeat key terms differ, and augmented TF captures those differences cleanly.

The max normalization also has a nice property for corpus-wide comparisons. Consider documents in different genres: a news article and an academic paper may cover the same topic but with very different writing densities. Normalizing by max count within each document makes the frequency signals comparable across genres, because the normalization is always relative to the author's own most-used term.

When to use augmented TF: It's widely used in information retrieval applications where document length varies significantly, and it was historically popular in the SMART notation system, developed at Cornell University in the 1960s and 70s. SMART used letter codes to describe IR weighting schemes: 'a' for augmented, 'n' for natural (raw), 'l' for logarithmic, and so on. SMART's systematic taxonomy of weighting options directly inspired modern TF-IDF implementations, and understanding it helps explain why the field settled on the specific formulas it did. In practice, L2 normalization has largely supplanted augmented TF for machine learning applications because of its better theoretical properties, but augmented TF remains relevant for understanding the design space and for applications where per-document relative emphasis is the primary signal of interest.