← Manj ChennaEssays

The stakes · Economics

Four places missing oversight hits the balance sheet

Removing the human looks like a saving on the day you do it. The bill arrives later, on different pages, attributed to other causes. Here is where to look for it before it finds you.

Manj Chenna · Founder, Sanctity · Building human judgment infrastructure · Amsterdam

Weak human oversight of AI is not a free choice with a compliance asterisk. It is a cost, and like most slow costs it hides by spreading itself across categories that nobody totals together. There are four places it lands, and naming them is the first step to pricing the thing you are actually trading away when you thin out meaningful human oversight.

The four places

  1. Liability. When an automated decision causes harm and no person exercised judgment over it, you own the outcome with none of the mitigation real review provides.
  2. Rework. Errors a person would have caught at the point of decision surface later, downstream, where unwinding them costs far more than catching them would have.
  3. Churn. A customer who receives a decision they cannot appeal to a human remembers it, and prices that memory into whether they stay.
  4. Regulatory. As meaningful human oversight becomes a legal requirement for high-risk AI, a system built without it is one you rebuild under a deadline, not on your own schedule.

Why the total never gets added up

Because each cost lands on a different day and a different ledger. The liability is a legal matter, the rework is an operations line, the churn is a marketing metric, the regulatory hit is a compliance project. No single owner sees the sum, so the connection back to the one decision, removing the reviewer, never gets drawn. The discipline is to draw it in advance, while it is still cheap to act on.

Read on

See the cornerstone, what it costs when no human is really in the loop, and one cost up close, the trust tax.