https://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/constitutional-ai2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/the-problem-with-pure-rlhf2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/the-constitution2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/supervised-learning-from-critique-and-revision2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/ai-feedback-for-preference-learning2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/cai-training-combining-the-two-stages2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/a-worked-example-critique-and-revision-in-action2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/code-implementation2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/empirical-effectiveness-of-constitutional-ai2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/limitations-of-constitutional-ai2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/connection-to-broader-alignment-research2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/summary2026-03-09T18:46:57.000Zhttps://mbrenndoerfer.com/writing/constitutional-ai-principles-critique-revision-cai-training/quiz2026-03-09T18:46:57.000Z