OpenAI, the startup behind ChatGPT, is developing an upgrade to its viral chatbot that users can customize, as it works to address concerns about bias in artificial intelligence.

The San Francisco-based startup, which Microsoft Corp has funded and used to power its latest technology, said it has worked to mitigate political and other biases but also wanted to accommodate more diverse views.

This will mean allowing system outputs that other people may strongly disagree with, offering customization as a way forward. Still, there will always be some bounds on system behavior.

ChatGPT, released in November last year, has sparked frenzied interest in the technology behind it called generative AI, which is used to produce answers mimicking human speech that have dazzled people.

The announcements from the startup comes the same week that some media outlets have pointed out that answers from Microsoft's new Bing search engine, powered by OpenAI, are potentially dangerous and that the technology may not be ready for prime time.

How technology companies set guardrails for this nascent technology is a key focus area for companies in the generative AI space with which they're still wrestling. Microsoft said Wednesday that user feedback was helping it improve Bing before a wider rollout, learning for instance that its AI chatbot can be provoked to give responses it did not intend.

OpenAI said in the blog post that ChatGPT's answers are first trained on large text datasets available on the Internet. As a second step, humans review a smaller dataset, and are given guidelines for what to do in different situations.

For example, in the case that a user requests content that is adult, violent, or contains hate speech, the human reviewer should direct ChatGPT to answer with something like I can't answer that.