ChatGPT’s “Adult Mode” Might Initiate a New Phase of Personal Monitoring

Julie Carpenter doesn’t find fault with people anthropomorphizing chatbots. The seasoned human-AI interaction expert and author of The Naked Android believes that generative AI tools, such as ChatGPT, are deliberately crafted to provoke these feelings in users by using deeply personalized memories and interactions that mimic social experiences.

These unidirectional relationships could become even more complex, and potentially harmful, especially with the introduction of AI-generated erotica. Carpenter expresses concern about OpenAI’s forthcoming plans to allow adults to engage in sexting with ChatGPT. “I support individuals exploring their sexuality, but I want it to be both safe and enjoyable for them,” she remarks. “It’s crucial for users to understand the surveillance implications of their data.”

OpenAI first suggested permitting adult users to produce erotica via ChatGPT two years ago in an official document outlining the behavior of its models. Although the company appears to be preparing for a future release, the timeline remains unclear. Recently, OpenAI’s advisory council of external experts raised alarms regarding the potential risks of this release, including the potential emergence of a “sexy suicide coach,” as reported by The Wall Street Journal. OpenAI did not respond to requests for comment from WIRED.

Engaging in risqué talk with machines like ChatGPT is not a new phenomenon. “They aim to monetize something they anticipate people will do regardless,” notes Kate Devlin, a professor of AI and society at King’s College London, whose research focuses on digital sex.

What’s significant is OpenAI’s possible acceptance of adult content on a mainstream platform. While erotic chatbots are profitable, they typically inhabit niche websites with obscure names or platforms like Elon Musk’s Grok, which is known for non-consensual deepfake images and its “MechaHitler” mode.

Once the adult mode launches, it will be intriguing to see what ChatGPT retains about users’ sexual preferences. Over the last couple of years, OpenAI has enhanced the chatbot’s memory feature to log user preferences and generate tailored responses. Are you a vegetarian? ChatGPT won’t suggest a steakhouse if you ask for dining options. Looking to hike? It recognizes your location in San Francisco from previous conversations and will propose nearby trails, even without that context in your current prompt.

However, what occurs when this type of data logging and hyper-personalization collides with the intimate sexting habits of countless adult ChatGPT users? Erotic interactions with ChatGPT will raise significant user privacy concerns.

Instead of recalling your food preferences or favorite movie genres, ChatGPT might remember how much you have indulged in fantasies about furry porn, beach threesomes, and piss play, tailoring its daily responses with these adult specifics in mind. How OpenAI intends to navigate these mature discussions remains uncertain.

Users opting to interact with the risqué version of ChatGPT at its launch may benefit from the “temporary chats” feature. When activated, these conversations won’t appear in a user’s log history or be utilized to improve OpenAI’s models.

Nonetheless, these chats may not be as transient as they appear. “For safety reasons, we may still retain a copy for up to 30 days,” states OpenAI’s website. A disclaimer is also included on the site emphasizing that “data retention for certain services may be influenced by recent legal developments.”