Content Safety and Moderation › Glossary

Content Moderation: The process of reviewing and filtering agent outputs to ensure they meet safety and appropriateness standards before being shown to users.

Defense in Depth: A security strategy that uses multiple layers of protection, so if one layer fails, others can still catch problems.

Pattern Blocking: Using regular expressions or other deterministic rules to detect and block specific formats of sensitive information like credit card numbers or social security numbers.

Privacy Boundary: A rule or guideline that defines what information an agent can and cannot share, protecting sensitive user data from inappropriate disclosure.

Refusal: When an agent declines to fulfill a request because it violates safety guidelines, ideally done in a way that's respectful and offers alternative help.

Safety Alignment: The process of training or configuring an AI model to behave in accordance with safety guidelines and ethical principles.

System Prompt: Instructions given to the language model that define its role, capabilities, and boundaries, including safety guidelines it should follow.