AI researchers warned that recursive self-improvement could make advanced AI systems difficult to monitor, control, or align with human goals, potentially posing an existential threat

The possibility that advanced AI could cause human extinction or permanent catastrophe.

The process by which an AI system improves its own capabilities, enabling increasingly effective further improvements.