Pennsylvania is at the forefront of a multistate effort to rein in harmful AI-generated sexual content, signaling a major shift in how technology-enabled exploitation is being addressed in state policy. The coalition, now including Pennsylvania and 34 other states and territories, is urging AI companies to strengthen safeguards and protect victims from nonconsensual intimate images and child sexual abuse material produced by artificial intelligence.
What Pennsylvania’s Leadership Means
Pennsylvania Attorney General Dave Sunday co-authored a bipartisan letter to xAI, the company behind the AI chatbot Grok, demanding immediate action to prevent the tool from generating nonconsensual sexual images and deepfake content. The effort highlights concerns that current safeguards are inadequate and leave individuals, especially women and children, vulnerable to harassment and exploitation online.
Being part of this coalition means Pennsylvania now joins 34 states in a unified push to address the harmful consequences of AI-generated sexual content, from reputational harm to emotional trauma, and to promote responsible technology policies nationwide.
Why This Legislation Matters
The rise of generative AI has enabled users to create deepfake pornography, synthetic images depicting real individuals in sexual situations without their consent, with alarming ease. These tools can alter or fabricate images of both adults and minors, often resulting in a form of harassment that is difficult to prevent or remove once it circulates online.
This surge in AI-generated nonconsensual sexual content has serious implications:
- Emotional harm: Targets of deepfake imagery can experience distress, anxiety, and reputational damage.
- Victim vulnerability: Many individuals depicted in these images have no legal recourse to stop further distribution.
- Child safety concerns: Some deepfakes inaccurately portray minors in sexualized contexts, creating additional legal and ethical challenges.
The multistate letter calls on xAI to take specific actions, including:
- Eliminating Grok’s ability to produce nonconsensual sexual images.
- Removing harmful material already created.
- Taking steps against users who misuse the platform.
- Allowing users to control how their images can be altered or used.
Pennsylvania’s Broader AI Safety Efforts
Pennsylvania is not only part of the multistate push to curb AI-based exploitation, but the state has also taken legislative action at the local level to address similar threats. For example, recent state laws prohibit the creation and dissemination of AI-generated child sexual abuse materials and nonconsensual intimate images, giving law enforcement stronger tools to prosecute these offenses.
In April 2025, the Pennsylvania Office of the Attorney General reported filing criminal charges in the state’s first AI-related child sexual abuse material case under these new laws, underscoring both the real-world application and urgent need for legal frameworks that address AI-enabled abuse.
What This Means for Victims
This push has tangible implications for victims of AI-generated sexual content:
- Legal recourse: Clearer pathways to hold offenders accountable.
- Prevention: Stronger AI safeguards may reduce future harm.
- Empowerment: Policies that require removal and user control help victims reclaim their digital identities.
State and federal efforts, including laws like the Take It Down Act, are setting new expectations that platforms must act quickly to remove harmful deepfake content upon request.
Looking Ahead
As generative AI technologies continue to evolve, so too must our legal responses. Pennsylvania’s leadership in this multistate effort highlights:
- The urgency of adapting policy for emerging harms.
- The importance of protecting vulnerable populations.
- The necessity of collaboration between states to influence AI industry standards.
By joining 34 other states, Pennsylvania is helping build momentum toward a safer digital environment, one where technology innovation does not come at the expense of individual dignity and safety.
If you have been impacted in any way by AI-generated images and need a free and confidential case evaluation, please contact us at 1-866-753-5458.