Regulation

San Francisco orders Apple and Google to remove ‘nudify’ apps tied to non‑consensual deepfake images

San Francisco City Attorney David Chiu has demanded that Apple Inc.

San Francisco orders Apple and Google to remove ‘nudify’ apps tied to non‑consensual deepfake images

San Francisco’s City Attorney has sent letters to Apple Inc. and Google LLC instructing them to remove dozens of so‑called “nudify” apps from their app stores. These applications can digitally alter photos to produce unclothed images of people. The action was announced by San Francisco City Attorney David Chiu in a statement emailed to TechCrunch.

Legal context and the city’s case

The city’s letters reference California law, which criminalizes any activity that “knowingly facilitates” or “recklessly aids or abets” the creation of non‑consensual deepfake pornography. In 2025, California also enacted a law enabling victims to bring civil suits against third‑party facilitators of such material.

According to the letters — seen by TechCrunch — Apple and Google have “been on notice” for nearly a year about their role in processing payments for illegal purchases, yet the companies have continued to host and profit from these apps. Chiu said in his statement: “Apple and Google are profiting off apps that exploit women and girls by generating nonconsensual intimate deepfakes. While the companies cut ties with some problematic apps, Apple and Google have a responsibility to be proactive and vigilant to prevent sexual abuse.”

Prior warnings and reports

The letters cite earlier warnings: in January and again in April, the Tech Transparency Project (TTP) published reports and sent letters to both firms, identifying “dozens of apps” in their stores that sold deepfake NCII (non‑consensual intimate images) in exchange for payments processed by the companies. TTP’s April report alleged that Google and Apple had intentionally “steered” users toward such apps and described both firms as “key participants in the spread of AI tools that can turn real people into sexualized images.”

Chiu also told Wired that both companies had likely earned “millions of dollars in fees” from apps offering those services.

Potential consequences and deadline

Chiu’s office warns that Apple and Google could face civil penalties for violating the law. The letters request that the companies contact the city within 28 days to address the matter.

Responses from Apple and Google

When contacted by TechCrunch, an Apple spokesperson said that nudify apps are prohibited from appearing in the App Store. Apple stated it has removed three of the apps in question and is in the process of terminating those developers’ accounts from its program; it is also in contact with four other developers about policy violations and said they risk removal if they fail to comply.

A Google spokesperson said that all five Play apps referenced in Chiu’s letter had been suspended from Google Play. The spokesperson added that when violations are reported they investigate and act swiftly — in this case suspending hundreds of violating apps and restricting related store search terms such as “nudify.”

Who is affected?

Deepfake pornography has largely targeted female celebrities in the past, but nudify apps make it possible for anyone with a publicly available photo to become a target.

Update July 17: This article was updated to include statements from Google and Apple.