Alignment Tax

Fact

The extra cost or slower performance needed to make AI safer and easier to control.

In Plain Words

Safety rules are like a roll cage in a race car. It can save the driver. It also makes the car heavier and slower.

Teams give up some speed or skill for safer answers. Training and testing can cost more too.

Related Concepts

• Alignment
• Reinforcement Learning from Human Feedback
• Constitutional AI

Alignment
Alignment Tax is the price of making AI safer and easier to control.

RLHF
RLHF adds human feedback and training work. This can raise the Alignment Tax.

Constitutional AI
Constitutional AI uses rules to guide AI. Those rules can limit its answers.