Multimodal Applications › Limitations and Practical Considerations

Multimodal applications have made extraordinary progress over the past five years, but several important limitations should temper enthusiasm for real-world deployment. Understanding these limitations is not pessimism. It is the prerequisite for building trustworthy systems.

Hallucination is perhaps the most significant challenge for multimodal systems in high-stakes applications. Models trained to generate fluent text can produce confident, well-formed descriptions of image content that is absent. In document understanding, this means a model might report an invoice total that does not appear in the document. In medical imaging, it might report a finding that is not visible in the scan. The fluency of the output makes hallucination hard to detect without manual verification, because a hallucinated sentence reads exactly like a factual one.

Several evaluation benchmarks specifically target hallucination in multimodal models. POPE (Polling-based Object Probing Evaluation) asks yes/no questions about object presence in images, where some objects are absent. Hallucination rates on POPE vary widely across models, from around 20% for weaker models to under 5% for the strongest current systems. However, even 5% error rates may be unacceptable in medical or legal contexts where errors have real consequences.

The basic source of hallucination is that language priors are stronger than visual signals for rare or ambiguous content. If an image shows an unusual pattern that superficially resembles a common one, the model's language prior pulls it toward describing the common pattern, overriding the actual visual evidence. A radiological shadow in an unusual position might be described using the vocabulary for a common finding it resembles, even though the clinical interpretation is completely different. Grounded generation, contrastive training, and post-hoc verification are partial mitigations, but no complete solution exists. The basic tension between fluency (which benefits from strong language priors) and factual accuracy (which requires deferring to visual evidence over prior expectations) has no easy resolution.

Models trained on natural images often fail to generalize to specialized domains like medical imaging, satellite imagery, or scientific figures. A vision encoder pre-trained on ImageNet has learned features useful for recognizing objects in everyday photographs, but medical images have different statistics (often grayscale, containing subtle intensity gradients), different scales of interest (a tumor may be a few millimeters in a 512x512 CT slice), and different semantic structure (the background is tissue, not sky or grass).

Fine-tuning on domain-specific data is needed but requires careful data collection. Medical imaging data is subject to privacy regulations and institutional review board requirements that limit data sharing across institutions. Scientific figure data requires licensing agreements with publishers. The result is that domain-specific datasets are smaller and harder to access than general web data, and models trained on them may overfit to specific formats and institutions as well as patient populations represented in the training set. A model that reaches high performance on data from one hospital system may perform substantially worse on data from a different system with different imaging protocols and patient demographics.

Multimodal models are substantially more expensive to run than text-only models. A vision encoder processing a 224x224 image adds hundreds of millions of multiply-accumulate operations on top of the base language model computation. Video models compound this further: processing 32 frames means 32 separate vision encoder passes plus the cross-frame attention overhead.

For real-time applications such as live video analysis and interactive document exploration, inference latency becomes a hard constraint. The techniques developed to reduce language model inference cost, including quantization, speculative decoding, and KV caching, extend to multimodal models but with additional complications. Vision encoder outputs are high-dimensional and cannot always be cached across requests. The visual token sequence added to the context can be much longer than typical text prompts, increasing memory bandwidth requirements. And the multi-modal context means that both the visual and textual components must be resident in GPU memory simultaneously.

Efficient vision encoding is an active area of research. Token compression techniques that reduce the number of visual tokens passed to the language model (through pooling, pruning, or learned merging) can substantially reduce latency without proportional quality loss. The tradeoff between visual resolution (more tokens, more detail) and computational efficiency (fewer tokens, faster inference) is a key design choice for production systems.

Current multimodal benchmarks have significant gaps relative to real-world task requirements. DocVQA evaluates single-page document understanding; real enterprise document workflows involve multi-page documents with cross-page references, version histories, and accompanying correspondence. MedQA-VQA evaluates structured question answering on predefined questions; real radiology workflows involve open-ended reporting where the clinician must identify what is relevant without a prompt. NExT-QA evaluates short-clip video QA; real video applications involve hours of footage where the key content may be sparse and unpredictable.

This benchmark gap means that impressive benchmark scores do not straightforwardly translate to deployment success. A model that reaches 90% on DocVQA may still fail regularly on the specific document formats used in a particular organization. A model that reaches 85% on POPE may still produce clinically dangerous hallucinations on unusual pathology cases that are rare in benchmarks but common in practice. Careful task-specific evaluation on real data distributions, with appropriate error analysis and failure mode characterization, remains needed before deploying multimodal systems in any high-stakes production context.