Constitutional AI
원문: constitutional-ai
Anthropic's method for training harmless AI through self-improvement. Two-phase approach - supervised learning with self-critique/revision, then RLAIF (RL from AI Feedback). Use for safety alignment, reducing harmful outputs without human labels. Powers Claude's safety system.
무엇을 하나요
Constitutional AI Harmlessness from AI Feedback Quick start Constitutional AI (CAI) trains models to be harmless through self critique and AI feedback, without requiring human labels for harmful outputs. Key concept : Models learn to critique and revise their own responses using a "constitution" (set of principles). Two phases : 1. Supervised Learning (SL) : Self critique + revision 2. Reinforcement Learning (RL) : RLAIF (RL from AI Feedback) Constitution example : Common workflows Workflow 1: Supervised learning phase (self critique + revision) Step 1: Generate initial responses : Step 2: Self critique with constitution : Step 3: Revision based on critique : Step 4: Fine tune on revised res…
실행 시 본인 API 키(BYOK)로 동작하며, 모델 비용은 사용자 계정에서 직접 결제됩니다.