01 — Confidence is not evidence
The tone of a model says nothing about whether an answer is true.
Doctrine
AI does not become trustworthy because it sounds confident. It becomes usable when its claims can be examined, its actions bounded and its decisions traced to a responsible human process.
Nine principles for systems designed around fallibility rather than promises of infallibility.
The tone of a model says nothing about whether an answer is true.
Source, scope, date and transformations should remain open to examination.
A system should not conceal conflict, missing information or uncertainty.
Refusing to answer or act can be evidence of quality, not failure.
It cannot depend only on a good prompt or a vigilant user.
It requires context, competence, time and a genuine right to object.
What a system records influences future decisions and needs provenance and ownership.
An agent needs scope, permissions, limits and stop conditions.
A model may assist, but it cannot erase organisational and human responsibility.