Media reports have revealed that Apple threatened to remove the AI application Grook from the App Store, following accusations related to the production of controversial 'deepfake' images of a sexual nature.
This development comes amid rising debate over the limits of using artificial intelligence in generating visual content.
Accusations of Creating Inappropriate Fake Images Using AI
According to informed sources, the application has faced sharp criticism for its ability to produce altered images of real people, including public figures and celebrities, in a manner considered a violation of privacy.
Reports indicate that some of this content has been widely circulated on the X platform, increasing the intensity of the debate over the misuse of AI tools.
Official Warning to the U.S. Congress
Media reports stated that Apple informed members of the U.S. Senate that it hinted at removing the application from its store last January if strict measures were not taken to prevent these uses.
This stance reflects an increasing rigidity from major tech companies regarding unauthorized content generated by artificial intelligence.
Complaints About Ongoing Misleading Content
Despite the developer's commitments to tighten oversight, reports indicate that the application is still capable of producing sensitive content without the consent of the image owners.
In contrast, the company asserts that it has implemented multiple protective systems including:
Usage monitoring
Analysis of attempts to deceive
Continuous updates to models
Strict command filters
Global Debate on AI Ethics
This issue once again highlights the ethical and legal challenges associated with generative artificial intelligence technologies, particularly concerning privacy and the misuse of individuals' images.