Ethical Guidelines and Human Oversight › Why Ethics Matter for AI Agents

Michael BrenndoerferAugust 16, 20251 min read
AI Agent HandbookAll chapters
Part 13 of 15Safety and Governance - Keeping the Agent Aligned
Chapter 38Ethical Guidelines and Human Oversight › Why Ethics Matter for AI Agents
Reading section 2 of 12 · Why Ethics Matter for AI Agents · 1 minSection 2 of 12 · 1 min

Book contents

Section 2 of 12 · 1 min read

Ethical Guidelines and Human Oversight › Why Ethics Matter for AI AgentsOne section · Sections in this chapter2 / 12 ↓

Let's start with a scenario. Imagine your personal assistant has access to your calendar and email. A colleague asks to schedule a meeting, but you're already overbooked. Your agent could:

Option A: Automatically decline, saying you're too busy.

Option B: Cancel your least important existing meeting to make room.

Option C: Ask you which meeting to reschedule, if any.

All three options are technically feasible. But which is ethically appropriate? That depends on your values, your relationships, and the context. Option A might seem efficient but could damage relationships. Option B assumes the agent knows which meetings matter most (it probably doesn't). Option C respects your autonomy but requires your time.

This is the kind of judgment call that technical safety measures alone can't handle. You need ethical guidelines that help the agent navigate these gray areas.