OpenAI is considering allowing users to create AI-generated porn

A OpenAI, the company behind ChatGPT, is exploring whether users should be allowed to create artificial intelligence (AI)-generated pornography and other explicit content with its products. Although the company highlighted that its ban on deepfakes continuouslyaria to apply to adult material, activists suggested the proposal undermined its mission statement of producing “safe and beneficial” AI.

🇬🇧 Subscribe to the best newsletter about AI (in English 🇬🇧) 

(I.e. Sign it the best newsletter about AI (in Portuguese 🇧🇷)

A OpenAI, which is also the developer of the image generator DALL-E, revealed that it was considering allowing developers and users to “responsibly” create what it called “not safe for work” (NSFW) content through its products. A OpenAI said this could include “eroticism, extreme violence, unsolicited insults and profanity.”

The company stated: “We are exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts… We hope to better understand user and societal expectations about model behavior in this area.”

The proposal was published as part of a document from OpenAI discussing how it develops its AI tools. Joanne Jang, an employee of the San Francisco-based company who worked on the document, said the OpenAI wanted to start a discussion about whether generating erotic text and nude images should always be prohibited in your products. However, she stressed that deepfakes would not be allowed.

“We want to ensure that people have maximum control as long as they don’t violate the law or other people’s rights, but allowing deepfakes is out of the question, period,” Jang said. “That doesn’t mean we’re now trying to create porn with AI.”

Read also