← Manj ChennaEssays

Trust · Capability

Model size is not trust

A bigger model is more capable. It is not, by that fact, more trustworthy. Capability and trust are different axes, and confusing them lets a very smart system be a very unaccountable one.

Manj Chenna · Founder, Sanctity · Building human judgment infrastructure · Amsterdam

Model size is not trust. A larger, more capable model can be more useful, more fluent, and more dangerous, all at once, because capability says nothing about whether a human can oversee the thing, audit it, or appeal it. Those are the properties trust actually tracks, and they are orthogonal to the parameter count. Some of the least trustworthy deployments are the most capable, precisely because their fluency makes the missing oversight easy to forgive.

Why we conflate them

Because capability is visible and impressive, and trust is quiet and structural. A model that writes beautifully feels trustworthy, and the feeling is doing work the evidence has not earned. Fluency is persuasive. It is also exactly the quality that makes an unaccountable system feel safe to lean on.

What trust actually tracks

Whether oversight is real, whether decisions are auditable, whether recourse exists. None of those improves automatically with scale, and a bigger model with none of them is a bigger liability, not a smaller one. Trust is a property of the system around the model, the human judgment infrastructure, not of the model's size.

Read on

See what trustworthy AI requires and trust is engineered, not advertised.