🔍 Picture this: you paste an article into ChatGPT and ask it to fact-check. It comes back with a confident, well-organized breakdown. Cites things. Uses bullet points. Reads like real analysis.
Then you check the sources. Half don’t exist. The other half say something completely different. The model didn’t verify anything. It rearranged what it already believed and dressed it up as research.
That’s the problem a developer named u/Smooth_Sailing102 decided to actually fix. The result is TruthBot, a free, open-source fact-checking tool built around one core idea: force a process so the model can’t just guess and sound convincing.
📋 Why This Actually Matters
Most AI fact-checking fails at the fundamental level. Language models don’t verify. They summarize. When you ask one to fact-check something, it pulls from training data, not live sources. It confirms what it already knows, which means it’ll confidently back up false claims if those claims match its priors.
The output sounds authoritative. The process is closer to vibes.
TruthBot is built on a zero-trust principle: don’t trust the model, don’t trust the text, and don’t trust the conclusion unless you can trace it back to real sources. Instead of one prompt asking “is this true,” it breaks the work into structured steps:
- Extract specific claims from the text
- Check each claim against retrieved sources (not model memory)
- Assess whether those sources are actually independent of each other
- Analyze how the argument is rhetorically framed
That last part matters more than most people realize. Understanding HOW something is trying to persuade you is often more useful than knowing whether the specific facts check out.
🔧 Two Modes, Same Zero-Trust Foundation
Version 7.2 added something the builder didn’t plan for. The original design assumed users would mostly feed it documents: articles, speeches, reports. What actually happened was people kept just asking questions. So he adapted.
Document Analysis mode: Paste in any text. TruthBot extracts claims, evaluates evidence quality, checks whether the sources are genuinely independent, and flags rhetorical manipulation techniques. Good for analyzing anything someone is actively trying to convince you of.
Research Assistant mode: Ask a question directly. Instead of pulling from model memory, it searches first, surfaces real sources, and builds the answer from what’s actually retrieved. Same zero-trust approach, different entry point.
The distinction matters because the failure modes are different. Document analysis catches manipulation in existing content. Research mode prevents the model from inventing a confident answer where none exists.
💡 Tips for Getting More Out of It
- Feed it dense content. The more claims packed into a text, the more value you get. Thin content produces thin analysis.
- Use Research mode for contested topics. Anything where the model might carry strong training biases (politics, health, recent events) is exactly where source-grounded answers beat memory-based ones.
- Don’t skip the rhetoric section. Most users focus on whether the facts check out and ignore the framing analysis. That’s leaving half the value on the table.
- Watch for source clustering. Five citations that all trace back to a single press release are not five independent sources. TruthBot flags this. Pay attention when it does.
🚀 Where to Find It
TruthBot is fully open source. No data collection, nothing being sold. The full prompt logic is documented publicly so you can read exactly how the process works, fork it, or build on top of it. The developer dropped both a ChatGPT link and a Google Doc with the complete prompt architecture in the comments of his Reddit post.
If you’ve been burned by AI confidently telling you something wrong, this is worth your time. It doesn’t guarantee truth. But it does guarantee you’re not just getting model confidence dressed up as verification. That’s a meaningful difference.
Frequently Asked Questions
Q: How is TruthBot different from regular AI fact-checking?
Most fact-checking just asks the model to verify and trusts whatever it says. TruthBot forces a real process: it breaks down claims, checks them against actual sources, and analyzes how the argument’s trying to persuade you. Instead of the model guessing and sounding convincing, you get a disciplined trail back to evidence.
Q: Can I use this for my own documents and questions?
Totally. You can analyze existing documents (articles, speeches) for claims and rhetoric, or just ask research questions and get answers built from actual sources. The v7.2 update added Research Assistant mode because that’s how people were actually using it, asking questions instead of analyzing full documents.
Q: What’s the deal with sources, how does it know what’s reliable?
It searches first, surfaces what it finds, and prioritizes independent sources over each other. Instead of relying on what the model “remembers,” it builds answers from what’s actually retrieved. The whole point is tracing every claim back to real evidence, not trusting the AI’s internal knowledge.
Q: Is this a commercial product I have to pay for?
Nope. It’s completely open source, no data collection, nothing being sold. The creator even published the full prompt logic in a public Google Doc so you can see exactly how it works or modify it yourself.
Update: Turns out people weren’t using my fact-checking AI the way I expected, so I upgraded it
by u/Smooth_Sailing102 in PromptEngineering