Ask ChatGPT the same “should I do X or Y” question twice. Same facts, two fresh chats, nothing changed except the order you list the options in. Redditor u/Ok_Negotiation_2587 ran exactly this test on r/ChatGPTPromptGenius and found the verdict flips more often than you’d expect. Not because the model changed its mind between chats. Because it was never weighing both options evenly to begin with.
This isn’t a one-off glitch. It’s documented in AI evaluation research: when models judge two answers side by side, they tend to favor whichever one lands in a certain position. The same pattern shows up in everyday decisions too: which job offer to take, which apartment to sign for, which laptop or headline to pick. Whatever you type first, or describe with the warmest language, becomes the frame the rest of the answer gets built around.
Quick start: run the same question twice with the options flipped. If the answer holds both times, trust it. If it flips, you’ve found a close call the model was dressing up as an obvious one. Four prompts below handle the rest, straight from the original poster’s thread.
The old way is asking once and taking the recommendation at face value. You type your question, ChatGPT hands you something confident-sounding, and you move on with your day. The problem is that confidence is manufactured. The model builds its answer word by word from what’s already sitting in the conversation. Whatever comes first sets the frame for everything that follows.
The new way treats a single AI answer as one data point instead of a verdict. You test the order, you strip your own lean out of the question, and you make the model argue both sides before it’s allowed to pick a winner. That costs you an extra minute or two. It also stops you from mistaking a coin flip for a clear-cut answer.
🔄 The four prompts, in order
Run the swap test for anything that actually matters. Open two fresh chats, ask the identical question in both, and reverse the order of the options in the second one. If the recommendation stays the same, trust it more. If it flips, the choice is closer than either answer let on, and the deciding factor is yours to name, not the model’s.
Only have time for one chat? Use the neutral framing instead. Paste this before you ask anything else:
“I am choosing between two options, listed in no particular order. Before recommending anything, make the strongest honest case for each one separately, as if it were the only option. Then name the single factor that actually decides between them. Then recommend, and if that factor is weak, say plainly that it is close.”
This works because it forces the model to build the strongest version of both frames before it’s allowed to declare a winner. It can’t lean on whichever option happened to load first.
Comparing three or more options changes the prompt again:
“Rank these options with a one-line reason each. Then tell me whether your ranking would change if I had listed them in reverse order, and if so, which positions are really a tie.”
That second sentence is the important part. It makes the model flag its own instability instead of hiding it behind a clean, confident-looking ranked list.
Last one: if you’re already leaning toward an option, don’t tell the model that. Strip phrases like “I am leaning toward,” “I really like,” and “or maybe” out of your question completely. The original poster found that your own lean steers the answer harder than the listing order ever does. A neutral question is the only way to get a neutral answer back.
Two caveats worth knowing
Sometimes the first option genuinely is the better one, and the swap test is how you’d confirm that instead of just assuming bias where there isn’t any. And a flipped verdict doesn’t mean both answers are wrong, it usually means the decision hinges on a factor you haven’t told the model yet. One commenter on the thread put it bluntly: you should always decide on the deciding factor yourself, not hand the whole call to an LLM. That’s the right instinct. These prompts aren’t about letting ChatGPT decide for you, they’re about stopping it from quietly deciding for you without you noticing.
Next time you’re stuck between two real options, don’t trust the first answer you get. Run the swap test on it. Or save the neutral framing prompt somewhere you can paste it in two seconds flat, a notes app works fine. The original thread has more examples of where this bias creeps in. Worth a scroll if you want to see how many everyday decisions it’s quietly shaping.
ChatGPT often recommends whichever option you mention first. Swap the order and it can change its mind
by u/Ok_Negotiation_2587 in ChatGPTPromptGenius