The Verification Loop
How to force AI (and myself) to stop making things up
The verification loop is basically a way of checking an idea/answer before acting on it by forcing it to challenge itself.
Instead of taking the initial answer at face value, you generate questions that would expose weak assumptions, gaps in logic, or plain optimism. Each question is then answered independently and honestly, without protecting the original conclusion.
Then you revise the answer based on what still holds.
The goal is to achieve accuracy. Used correctly, the verification loop reduces self-deception, surfaces hidden risks, and turns AI from a confident answer machine into a tool for clearer thinking.
My Experiment
I recently tested a simple idea:
Create a small digital product, run a small paid ad test, and see whether strangers will buy. No audience. No outreach. No hype.
Most advice about making money online generated by AI sounds overly easy and confident. Instead of just relying on AI for its answers, I asked it to verify its own answers.
This article explains the verification loop I used, why it works, and why this mindset matters, especially when using AI as a research tool.
(I have included the actual prompt at the end of this article)
The question
I started with this question:
If I sell a $29 digital product using paid ads, how much ad spend is needed to see real buying signals? And is this why people keep saying “build an audience”?
I wanted to know whether spending $100 on ads would be sufficient if I used only ads as the primary driver of sales.
Step 1: The initial AI answer
The initial answer looked reasonable on the surface:
Typical (CPC or Costs Per Click) ad clicks cost around $1 to $3
Cold traffic conversion rates are usually under 2%
A $100 ad test might get clicks and maybe a sale, but you will not have enough information to show whether it really works.
So far, so good.
Step 2: Force verification questions
Then I added another step.
I asked AI to come up with questions to show whether it made any mistakes in its own thinking.
Here are the key ones:
Are those CPC and conversion ranges actually realistic, or just commonly repeated?
Is 300 to 500 clicks really a meaningful threshold, or an arbitrary marketing myth?
Do “career and money” products actually require more trust than impulse products?
Is $29 pricing constrained by value, or by perceived risk?
Is audience building an economic necessity, or just creator culture?
This step forces AI to look for gaps in its answers.
Step 3: Answer each verification independently
I then ask AI to answer each question separately, without looking back at the original answer. These were the answers to the verification questions:
The CPC and conversion ranges are not optimistic. They sit near the middle of reported benchmarks.
Small amounts of data do give messy results. This is a fact, not just an opinion.
Products related to money, skills, or changing jobs always need more trust than things people buy on a whim.
The cost of reaching new people depends more on how risky they perceive it to be than on the quality of the content.
People build their own audiences because trust grows over time, not because ads stopped working.
Nothing contradicted the original answer, but the thinking became much clearer.
Step 4: Revise the answer based on verification
After checking, the answer became clearer:
A $100 ad test can prove the possibility, not the viability of the experiment.
$300 to $500 is usually the minimum amount; if you want to see results you can count on.
Above $1,000 is when the numbers start to add up.
$29 is the right price for new customers. This is not because the product is ‘small’, but because trust is small. The higher the price, the more trust is needed.
Building an audience is a way to deal with the cost of earning trust.
Ads are a way of compressing the time it takes to build trust. They do not replace trust, but expose how expensive trust really is.
Why the verification loop matters
This process is not really about ads or products.
It is about learning how to think clearly in an environment saturated with confident claims.
The verification loop forces discipline:
It separates what sounds plausible from what is actually true.
It exposes assumptions that usually stay hidden.
It prevents confident answers from slipping through simply because they feel familiar.
Most AI failures are not due to hallucinations but unverified guesses that were never challenged.
When you force AI to question its own answers, it stops being a machine that produces “answers” and becomes a tool that helps you reason more carefully.
Why this applies beyond AI
The same verification loop applies to how you think day to day.
Any time you catch yourself clinging to a viewpoint, it is worth pausing and testing it.
For example:
“If I just work a bit harder, this will eventually pay off.”
“The timing isn’t right, that’s why this hasn’t worked yet.”
“Other people have an advantage I don’t have.”
“This approach makes sense, even though I can’t point to results yet.”
Instead of accepting the thought, run a verification loop.
Ask yourself:
What would need to be true for this belief to actually hold?
What evidence would prove me wrong?
What am I assuming without real proof?
Am I protecting an idea because it feels safe or familiar?
Most frustration in work and business doesn’t come from lack of effort or intelligence.
It comes from carrying beliefs forward without ever checking whether they are still true.
The uncomfortable conclusion
My original assumption about my experiment was partially right.
Yes, it is possible to create a product and sell it with ads, even today. But it does not magically bypass the economics of building trust.
AI reduces production cost but does not remove the problem of getting people to believe you.
That is why audience (and trust) building is important.
And building trust takes time.
Ads rent attention and compress exposure, not trust. They only work when the value proposition is strong enough to quickly earn trust.
Final thought
The valuable thing AI did was not just producing answers. It was also being forced to justify them.
That verification loop is often missing from most advice, whether it comes from humans or machines. Assertions are made, repeated, and trusted long before they are ever tested.
Once you adopt this habit, you stop just asking what might work and start asking what reality actually is.
That shift, more than any tool or tactic, is what leads to better decisions.
Chain-of-verification prompt
Insert Question here.
Now follow these steps:
Provide your initial answer
Generate a series of verification questions, depending on the complexity of your answer, that would expose errors in your answer
Answer each verification question independently and truthfully. Do not make it up.
Provide your final revised answer based on the verification