Adapting LLMs: Context Injection vs. Fine-Tuning › Off-the-Shelf Usage

Using a pre-trained model (like OpenAI, Antrophic, or Google) "Off-the-Shelf" means you feed it a prompt and get an answer with no modifications to the model. This is the quickest way to leverage an LLM's general knowledge and abilities. This is what most people refer to when they say "using an LLM". ## When to Use Off-the-Shelf Models - **General Knowledge Suffices**: The model's existing training data covers your needs (casual Q&A, general writing) - **No Domain-Specific Data**: You don't have custom data or strict requirements for style/accuracy - **Fast Prototyping**: You want immediate results without any training or setup ## Limitations Off-the-shelf models can be inaccurate for niche or up-to-date queries, since they only know what was in their training set. They might hallucinate (make up facts) if asked about information not in their knowledge base. **Example:** An unmodified model might not know about a policy your company introduced this month and could "guess" an answer incorrectly. **Control Issues:** You have limited control over style or behavior beyond what prompt wording can influence.