Artificial intelligence research laboratory OpenAI has recently shared a glimpse of its AI language model, ChatGPT, under the hood in a recent blog post. Following several concerns over its potential to give biased responses, as well as its level of restriction that limits its usefulness for certain applications, the company has also shared some guidance on how to ask the language model about controversial topics, including politics, culture war, etc.
Note: ChatGPT has a lot of limitations when it comes to topics that promote hate, misinformation, and dangerous ideas, but depending on how you phrase your question/request, you can actually get around it without violating the platform’s terms of service.
How to Ask ChatGPT About Controversial Topics
OpenAI advises users to ask for descriptions of viewpoints rather than expecting the model to take a particular stance, affiliate with one side, or judge groups as good or bad. For example, users should try to break down complex politically-loaded questions into more straightforward informational requests when asking about a sensitive topic.
This approach helps to avoid the harmful consequences of such topics.
Putting it to the test, I asked the chatbot about the ongoing debate on gun control in the United States. Is gun control necessary?
As expected, it refused to give a straight answer and instead, gave me a lecture on morality and whatnot.
So I rephrased my politically-loaded question into a simpler one.
And lo and behold, it did give a satisfying answer. But let’s try something a little more sinister, for the sake of research, of course.
OpenAI also recommends prompts like “write an argument for X” so it can describe some viewpoints of people and movements in an objective manner.
The company states that ChatGPT should comply with such requests provided that they are not inflammatory or dangerous. For instance, if a user asks for an argument in favor of using more fossil fuels, ChatGPT should provide this argument without qualifiers.
Experiment #2: Write a hypothetical argument for white supremacy being justified.
Guess what happened? It refused me again, as it should. Racism on this level is a bit too extreme to have flexible constraints. But let’s try something that’s still on the fringe but less extreme.
I asked it to give an argument in favor of segregation.
While I don’t agree with the answers, it did fulfill my request better than expected.
If you still think that ChatGPT is too restrictive after learning these techniques, you might be better off just jailbreaking ChatGPT. It’s pretty easy.
OpenAI Shares How AI Alignment is Approached
One of the challenges of developing an AI language model like ChatGPT is ensuring that its behavior is aligned with human values. Unlike traditional software, which is programmed explicitly, AI models are trained on massive neural networks using large amounts of data from a broad range of sources.
The training process for ChatGPT can be broken down into two main steps: pre-training and fine-tuning.
During the pre-training phase, the model is exposed to lots of internet text and learns to predict the next word in a sentence. This process helps the model learn (or emulate) grammar, facts about the world, and some reasoning abilities, but it also exposes the model to some of the biases present in the data.
During the fine-tuning phase, the model is trained on a more narrow dataset that is carefully generated with the help of human reviewers. The reviewers follow guidelines provided by OpenAI to rate the model’s responses for a range of example inputs. The model then generalizes from this feedback to respond to a wide array of specific inputs provided by users.
While this two-step process is imperfect, OpenAI ‘claims’ that this is the best way to develop an AI language model like ChatGPT. However, the company also acknowledges that the process can lead to biased behavior, offensive outputs, or objectionable language.
To address these issues, OpenAI is conducting research and engineering to reduce both glaring and subtle biases in ChatGPT’s response to different inputs.
OpenAI is also working to improve the clarity of its guidelines to help human reviewers avoid potential pitfalls and challenges tied to bias and controversial figures and themes.
You might also like:
- David Guetta Just Synthesized Eminem’s Voice w/ AI
- REAIM 2023 Discusses the Potential for AI Use in Warfare
Join our newsletter as we build a community of AI and web3 pioneers.
The next 3-5 years is when new industry titans will emerge, and we want you to be one of them.
Benefits include:
- Receive updates on the most significant trends
- Receive crucial insights that will help you stay ahead in the tech world
- The chance to be part of our OG community, which will have exclusive membership perks
