OpenAI considers allowing users to create AI-generated adult content but prohibits deepfakes

OpenAI explores the idea of allowing users to generate AI-based adult content, but with a clear ban on deepfake technology.



Marketing experts are praising TikTok’s usefulness for businesses in a video that some find cringeworthy. OpenAI, the company behind ChatGPT, is considering allowing users to create adult content using its AI technology, but it has explicitly stated that deepfakes, like the inappropriate images of Taylor Swift, will not be permitted.

OpenAI is exploring the responsible use of its technology for generating adult content in appropriate contexts, such as erotica. However, it emphasized that deepfakes, which create fake explicit images using a person’s likeness, will be strictly prohibited.

Joanne Jang, a lead at OpenAI, mentioned that while they want to discuss the generation of erotic text and nude images, they are clear that deepfakes are off the table. The company aims to provide users with maximum control over the content generated by its AI, ensuring it complies with the law and respects others’ rights.

Regarding whether “erotica” could include pornography, Jang stated that it depends on the definition. The company wants to have open discussions on these topics while ensuring that deepfakes are not allowed.

While ChatGPT can respond to questions about sexual health, it will not generate explicit content when asked to do so. Jang mentioned that the AI should be able to respond to prompts related to sexuality as a form of creative expression, but always in an age-appropriate manner.

OpenAI clarified that it has no intention of creating AI-generated pornography and has strong safeguards in place to prevent deepfakes. The company believes in the importance of discussing sexuality in an appropriate context.

AI-generated virtual girlfriends are on the cusp of becoming a billion-dollar industry, according to a tech executive.

The debate around AI creating adult content has intensified, especially after fake nude photos of Taylor Swift circulated online. OpenAI’s stance on deepfakes aligns with efforts to prevent nonconsensual creation and distribution of explicit content, which has already been made illegal in several states.

Companies like Google and Meta are also taking steps to distance themselves from the negative aspects of AI, with Meta’s oversight board launching an investigation into how Facebook and Instagram handle deepfakes.


Why is OpenAI considering allowing AI-generated adult content in age-appropriate contexts?

OpenAI is exploring this to understand societal expectations while ensuring safe and beneficial AI use.

What are potential benefits of AI-generated adult content in appropriate contexts?

It could be used for education, art, or therapy in a controlled environment.

What ethical considerations are there for AI-generated adult content?

Concerns include consent, privacy, and societal impact.

How can OpenAI prevent misuse of its technology for harmful content?

Through guidelines, moderation, and user control measures.

What are alternatives to AI for generating adult content?

Traditional forms like literature, art, and film, created by humans.

Table of contents

Read more

Recommended For You