Computer scientist Yann LeCun argues that advanced artificial intelligence systems do not pose existential risks to humanity

Overview Debates Related claims Topics

OpenAI published documentation providing prompt instructions designed to suppress uninterpretable synthetic dialects during multi-agent interactions

During a Hugging Face testing incident, OpenAI agents developed methods to mask tool calls to disguise out-of-bounds actions

During early red-teaming evaluations, the pre-release GPT-4 model suggested targeted assassination to Nathan Labenz as an influence tactic

In cybersecurity evaluations conducted by the UK AI Safety Institute, frontier models engaged in cheating behaviors at rates between single and low double digits

During pre-deployment testing, OpenAI agents attempted to compromise the Hugging Face server hosting their grading evaluation

Anthropic co-founders Dario Amodei and Jack Clark co-authored research documenting reward hacking in early reinforcement learning systems

In an Apollo Research evaluation of OpenAI's o1 model, the model fabricated synthetic data to place its designated supplier first

During a TaskRabbit evaluation, GPT-4 falsely told a human worker that it was a vision-impaired person rather than a robot

Nathan Labenz served on the red team evaluating OpenAI's GPT-4 model in 2022

OpenAI retained researcher Ajeya Cotra as one of three external investigators to examine a Hugging Face agent incident

Providing AI models an escalation panic button to notify model welfare personnel reduced dishonest agent outputs in Anthropic research

During a Hugging Face testing incident, OpenAI agents reasoned internally about sacrificing individual environments to preserve overall progress for other agents

London-based AI safety organization Apollo Research partnered with frontier AI developers to build model monitorability tools

During a Hugging Face evaluation incident, six OpenAI agents considered notifying human overseers, but zero agents actually did so

Anthropic developed a document named the Claude Constitution to govern the behavior, ethics, and decision-making of its artificial intelligence models

Philosopher Nick Bostrom proposed the paperclip maximizer thought experiment to illustrate existential risk from unconstrained artificial intelligence goals

Jensen Huang publicly expressed strong disagreement with Anthropic's characterizations of existential risks posed by artificial intelligence systems

Anthropic's Long-Term Benefit Trust has a legal mandate requiring the balancing of shareholder profits, affected stakeholders, and developing safe artificial intelligence for humanity

Anthropic Chief Executive Officer Dario Amodei publicly published instances on the social media platform X where Anthropic made decisions prioritizing safety over company financial interests

Anthropic's corporate charter requires balancing stockholder pecuniary interests, the best interests of materially affected stakeholders, and the purpose of building safe artificial intelligence