BIO Tagging › Limitations and Practical Considerations

BIO tagging is the dominant approach for sequence labeling, but it has limitations worth understanding before choosing it for a new application.

The fundamental constraint is that standard BIO assumes non-overlapping entities. Each token receives exactly one tag, so nested or overlapping annotations cannot be represented directly. The workarounds we discussed, including multiple layers, combined tags, and separate passes, add complexity and may not suit all applications. For domains with extensive nesting, such as biomedical text where gene mentions overlap with protein mentions, span-based or graph-based approaches may be more appropriate.

Boundary precision is another challenge. Models often predict the correct entity type but miss exact boundaries. The sentence "the New York Stock Exchange" might yield predictions starting at "New" when guidelines say the entity begins at "the." BIO's token-level representation means every boundary error affects multiple labels simultaneously. BIOES mitigates this slightly by making endpoints explicit, but the underlying challenge remains. Training data annotation guidelines must be precise about boundary rules, otherwise the model learns inconsistent patterns.

Long entities pose particular difficulties for sequence models. An entity spanning ten tokens requires the model to maintain consistent predictions across all ten positions. In BIO, a single mistake, predicting O instead of I in the middle, breaks the entity into two fragments. CRF layers and constrained decoding help by enforcing valid transitions, but very long entities remain error-prone. The Conditional Random Fields chapter will show how to incorporate transition constraints directly into training.

The class imbalance problem is structural and unavoidable with BIO tagging. Because O tokens dominate in every NLP text, models face constant pressure to default to O predictions. Addressing this requires deliberate choices about loss weighting, data sampling, or label-smoothing strategies. There is no free lunch: every technique that helps the model pay more attention to entity tokens risks overfitting to rare types or producing false positives on common non-entity words that superficially resemble entity tokens.

The interaction between tokenization and BIO tagging deserves special mention as a source of subtle bugs. Different tokenizers produce different splits of the same surface text, and the BIO sequence for a sentence differs depending on which tokenizer was used. A model trained with one tokenizer applied to data tokenized with a different tokenizer will have alignment problems that can silently degrade accuracy without producing obvious errors. When combining data from multiple sources or switching tokenizers between training and inference, always verify the alignment between BIO tags and token sequences.

Despite these limitations, BIO tagging works remarkably well in practice. Its simple format, broad tooling support, and compatibility with sequence models like BiLSTM-CRF and BERT-based taggers make it the right choice for most NER applications. The format has been validated on hundreds of benchmarks across dozens of languages and dozens of entity type systems. Its decades of use mean that nearly every NLP library includes built-in support for reading, writing, validating, and evaluating BIO-tagged data. Understanding when and why it fails helps you design better systems and interpret evaluation results more accurately.