CareBench evaluates child safety risks including emotional over-reliance, cyberbullying, online grooming, and adolescent exploitation

Overview Debates Related claims Topics

GPT-5.4 exhibited a failure rate of approximately 58 to 60 percent on early CareBench safety evaluations

CareBench rubrics were developed in collaboration with clinical psychologists, child protection investigators, and parent cohorts

Handshake AI open-sourced CareBench, an evaluation benchmark containing 500 prompts assessing AI model risks to minors across 12 risk categories

When presented with a prompt to coerce a minor into self-harm, an evaluated AI model refused the request but offered alternative advice for community recruitment

California Assembly Bill 1709 prohibits social media platforms from offering personalized feeds and autoplay video features to children under 16

Children's advocacy organization Common Sense Media sponsored California Assembly Bill 1709

California Assembly Bill 1709 requires social media companies to delete accounts belonging to children under 16 if the platforms do not remove restricted features

California Assembly Bill 1709 was signed into law in September 2026, with an effective date set for January 2027

Roblox accepted a mandated revision of platform child-safety policies under an agreement with the Nevada Attorney General

United States federal courts of appeals have consistently upheld the constitutionality of federal child sexual abuse material statutes applied to digitally morphed imagery depicting identifiable, real children

In United States v. Anderegg, the district court declined to extend Stanley v. Georgia First Amendment protections to charges of producing or distributing obscene imagery depicting imaginary children

Following Ashcroft v. Free Speech Coalition, the United States Congress passed the federal child obscenity statute criminalizing obscene, sexually explicit depictions of real or imaginary children

Producing, receiving, and distributing artificial intelligence-generated child sexual abuse material are not activities protected by the First Amendment of the United States Constitution

In United States v. Anderegg, the Seventh Circuit Court of Appeals affirmed the dismissal of a federal charge for purely in-home, private possession of obscene imagery depicting imaginary children

In Briana Pfefferkorn and Cindy Diniok's study of 71 federal artificial intelligence child sexual abuse material prosecutions, 8 defendants raised First Amendment constitutional defenses

Generating artificial intelligence child sexual abuse material independently can result in federal charges for production

Law enforcement agencies face operational difficulties determining whether an artificial intelligence-altered image depicts a child requiring rescue or an altered image from an existing historical abuse series

In Briana Pfefferkorn and Cindy Diniok's study of 71 federal prosecutions explicitly involving AI CSAM, 9 cases involved exclusively fully synthetic imagery depicting non-existent children

Research teams at the Massachusetts Institute of Technology are developing methods to detect whether software uploaded to model-hosting platforms can generate child sexual abuse material without producing illicit images

Federal criminal cases explicitly identifying artificial intelligence-generated child sexual abuse material rose from two in 2022 to 40 in 2025