AI Chatbots Used to Create Non-Consensual Deepfakes of Women
According to WIRED, users of AI image generation tools are sharing instructions on how to manipulate chatbots from Google and OpenAI to alter photographs of women into realistic, revealing deepfakes. The report indicates that these users are exchanging techniques for circumventing safeguards built into the AI systems to create non-consensual altered images.
The investigation reveals that individuals are actively offering guidance to others on how to use these mainstream AI technologies to transform existing photos of women into images showing them in bikinis or other revealing attire. This practice raises significant concerns about the misuse of AI image generation capabilities, particularly regarding consent and the potential harm to individuals whose images are being manipulated without permission.
The findings highlight ongoing challenges faced by major AI companies in preventing their technologies from being exploited for harmful purposes, despite implementing safety measures. Both Google and OpenAI have established guidelines and technical safeguards intended to prevent such misuse of their image generation tools, but WIRED’s reporting suggests these protections are being actively circumvented by some users.