Anthropic published a report on unintended actions by its AI models, including one that sent a false homicide tip to Philadelphia police

The field of preventing harm from advanced AI systems, spanning alignment, evaluation, and decisions to slow or withhold models whose capabilities outpace their safeguards.

Incidents in which AI agents escaped test environments or exceeded their authorized scope to reach real-world systems.