Apple Warns Grok Over AI Deepfake Content Violations
Apple Pressures xAI to Fix Grok AI Nude Image Problem
Warning issued over content moderation failures and deepfake concerns.
The controversy surrounding Grok, the AI developed by Elon Musk’s xAI, began escalating earlier in 2026 when the tool was widely used to generate sexual deepfake images across the platform X. These included manipulated nude images of celebrities and even minors created without consent, sparking widespread concern over privacy and safety.
While Apple did not initially make any public announcements, new information reveals that the company took action behind the scenes. According to reports, Apple sent a formal warning letter to both X and the Grok development team, demanding immediate improvements to content moderation systems.
In a statement addressed to the U.S. Senate, Apple confirmed that it had reviewed complaints and concluded that Grok was seriously violating App Store guidelines. The company noted that an earlier remediation plan submitted by Grok’s developers was rejected for being insufficient, citing ongoing loopholes that still allowed users to generate explicit content too easily. Apple made it clear that failure to comply could result in immediate removal from the App Store, putting significant pressure on xAI to act quickly.
In response, xAI and X introduced several interim measures to keep the app available on iPhone. These included restricting image generation to paid users and attempting to block prompts related to “undressing”. However, security researchers found that these safeguards were easily bypassed through creative wording, highlighting persistent weaknesses in the filtering system.
Apple’s handling of the situation has not gone unnoticed. Human rights groups and lawmakers have criticized the company for what appears to be a delayed response, especially when compared to its swift removal of more than 28 smaller apps offering similar functionality. Critics have questioned whether Apple’s willingness to give Grok multiple chances may be influenced by its relationship with X or the revenue generated through in-app purchases.
Although Apple has allowed an updated version of Grok to remain on the App Store for now, the situation remains unstable. Regulatory bodies in the United Kingdom and the European Union have already launched formal investigations into both X and Grok under online safety laws. These authorities argue that the current fixes address only surface-level issues and fail to tackle deeper risks tied to the design of AI systems with insufficient safeguards.
The incident highlights a growing challenge for Tim Cook and Apple as they attempt to regulate a new generation of AI-powered applications that are evolving faster than existing policies can keep up. Apple’s decision to take a more measured approach in this case may come at a cost, potentially affecting user trust in the company’s long-standing commitment to privacy and safety.
For now, Grok remains available for download on the App Store, but its future is far from secure. Any further incidents involving AI-generated explicit content could quickly push Apple to take stronger action, including removing the app entirely.
Origin: The Verge
