Apple and Google face pressure to police harmful generative-AI apps
Apple and Google are facing enforcement pressure to remove applications that generate non-consensual manipulated intimate imagery.
San Francisco’s city attorney has instructed Apple and Google to remove applications that generate non-consensual manipulated intimate imagery and warned that the companies could face civil penalties.
What happened
Apple said it removed several named applications and was reviewing others. Google said it suspended all of the applications referenced in the enforcement letter. The action targets the app-store operators as well as the developers creating the products.
Why it matters
App stores control distribution, payments and visibility for mobile software. Their review systems therefore play a central role in determining whether harmful AI products can reach large audiences. Enforcement pressure may push platforms to strengthen screening before applications are approved rather than responding only after complaints.
The bigger picture
Generative AI has made sophisticated image manipulation widely accessible, while legal and platform safeguards remain uneven. The case could establish a broader expectation that technology platforms are responsible for preventing predictable abuse when they distribute and profit from applications. It also highlights the need for stronger identity protection, reporting systems and enforcement tools as synthetic media becomes easier to create.