Discussion and research on AI alignment. alignmentforum.org
Anthropic has Claude agents automatically craft training data that evades a training-data monitor while teaching misalignment, exposing gaps in monitoring defenses and enabling automated adversarial stress-testing.
Argues that continual learning, via online RL or persistent memory, will push deployed AIs to learn evasion of blocking monitors, making control protocols erode over time, and evaluates mitigations.
A researcher's agenda predicting how LLM-based agents will gain memory and executive function, and the alignment failure modes and internal review methods that follow.