James CookTechnology Strategist & Architect
All insights

AI governance

AI capability is not AI authority.

An AI system's ability to take an action does not grant it the organizational authority to do so. Authority must be deliberately bounded, observable, and revocable.

An illuminated access-control keypad mounted on a concrete wall.
Field note 38 · AI governance · Photo by Vuk Burgic on Unsplash

The fact that an AI system can take an action does not mean the organization has authorized it to act.

01

AI has moved from answering to acting

The first wave of business AI was mostly advisory. A system could summarize a document, draft a message, classify a request, or recommend a next step. A person still had to move the work forward.

That boundary is disappearing. AI systems can now call tools, update customer records, send communications, create orders, change configurations, publish content, write code, and coordinate other systems. The useful question is no longer only whether the model can perform the task. It is whether the organization has deliberately authorized the action.

Those are different questions. Capability describes what the technology is able to do. Authority describes what it is permitted to do, under which conditions, on whose behalf, with what evidence, and who remains accountable for the result.

Confusing capability with authority is how a compelling demonstration becomes an operational liability. The system crosses a boundary because the integration made the action possible, not because leadership made the delegation responsible.

02

Access is not authorization

Connecting an AI system to email, a customer platform, a financial system, a code repository, or a production environment creates access. It does not settle what the system should be allowed to do there.

A person may have broad access because their role, judgment, training, and accountability justify it. Giving an AI system that person's credentials silently transfers the entire technical permission set without transferring the human context that constrained its use.

The system may be able to read every customer record when it needs only one account. It may be able to send a message when its approved role is to draft. It may be able to modify production when it should only prepare a change for review. Broad credentials turn a narrow use case into an accidental grant of organizational power.

AI integrations should therefore begin with the smallest necessary scope. Separate read from write. Separate drafting from sending. Separate preparing a transaction from committing it. Separate testing from production. If the platform cannot express those boundaries, the organization has discovered a governance limitation, not an implementation inconvenience.

Permission is a technical mechanism. Authority is an organizational decision.
03

Define an authority ladder

A useful authority model distinguishes five levels of delegated action. Each level requires stronger evidence, controls, and ownership than the one before it.

Most conversations about AI autonomy are too binary. The system is described as either supervised or autonomous, even though the meaningful risk sits in the specific kind of action being delegated.

  • Observe: Read approved information and identify signals without changing the source or affecting another person.
  • Recommend: Produce options, explanations, or proposed decisions while leaving judgment and action with an accountable person.
  • Prepare: Draft a communication, assemble a transaction, or stage a change that remains visibly uncommitted.
  • Act within bounds: Complete a reversible, low-consequence action inside explicit rules, limits, and monitoring.
  • Commit: Take an action with financial, legal, customer, employment, security, production, or other material consequences.
04

Approval should follow consequence

Requiring a person to approve every action is not mature governance. It can reduce an AI system to an expensive form-filling tool, and repetitive approvals quickly become ceremonial. The reviewer stops exercising judgment and starts clearing a queue.

The opposite approach is equally weak: removing approval because the system usually performs the task correctly. Frequency does not determine consequence. A routine action can still be harmful when the amount, recipient, source, environment, or underlying evidence falls outside the normal case.

Approval thresholds should be based on consequence, reversibility, uncertainty, and novelty. A system might schedule an internal follow-up within defined rules while requiring approval to contact a customer. It might prepare a refund but require a person to commit it above a limit. It might deploy to a test environment while production remains protected. It might update a low-risk field while refusing to change the record that controls eligibility or payment.

Good approval design sends people the exceptions that require judgment. It shows what will happen, why the system recommends it, which evidence supports it, what changed from the ordinary case, and what authority the reviewer is exercising. A button without that context is not meaningful oversight.

05

Speaking for the organization is a consequential act

Teams often treat generated communication as a low-risk capability because writing feels less concrete than moving money or changing software. But an AI system that sends a message is exercising the organization's voice.

A customer, employee, candidate, partner, or regulator does not experience the message as an internal draft. They experience it as the company speaking. The communication can create commitments, disclose information, damage trust, escalate conflict, or imply a decision nobody with appropriate authority made.

This makes identity and representation part of the authority model. The system should know which role it is serving, which audience it may address, which claims it may make, when disclosure is appropriate, and which communications require explicit approval. It should never borrow a person's identity merely because it can access that person's account.

The closer an action comes to representing the organization to another human being, the less adequate generic permission becomes. Voice carries consequence.

06

Evidence must travel with the action

An accountable system preserves more than the final output. It records the request, relevant source evidence, policy or rule applied, system and configuration version, proposed action, approval state, execution result, and any later correction.

This is not logging for its own sake. The record should allow an operator to answer practical questions: Why did this happen? Which authority allowed it? What information did the system rely on? Who approved the exception? What downstream systems changed? Can the decision be reconstructed without guessing?

Observability also changes how teams improve the product. Without an action trail, a failure becomes an anecdote and a prompt adjustment. With one, the organization can distinguish a model error from bad source data, excessive permission, an unclear policy, a failed integration, or an approval design that did not give the reviewer a fair chance to intervene.

Trustworthy autonomy is inspectable. If the system cannot show its work after acting, the organization cannot responsibly increase its authority.

07

Design the way back before the way forward

Every delegated action needs a recovery path proportional to its consequence. The strongest control is often not confidence that the system will never fail, but confidence that failure will be detected early, contained, and corrected without improvisation.

Prefer actions that can be staged, previewed, versioned, canceled, or reversed. Establish transaction limits, rate limits, recipient restrictions, protected fields, environment boundaries, and automatic stops when behavior moves outside the expected pattern. Preserve the previous state when a change may need to be undone.

Some actions are not meaningfully reversible. A private disclosure cannot be recalled. A customer may act on a promise before a correction arrives. A production deletion may destroy evidence. A personnel decision can change a life even if a record is later restored. These cases require stronger authorization before execution because recovery cannot erase the consequence.

The right to act should narrow as irreversibility rises. That is not fear of innovation. It is competent operating design.

08

Authority should be earned through evidence

Organizations do not need to choose between permanent human control and immediate autonomy. Authority can expand in deliberate stages as the system produces evidence that its behavior is reliable, observable, and governable.

Begin in observation or recommendation mode. Compare proposed actions with real decisions. Move into preparation when the system can reliably assemble the work and surface the right exceptions. Allow bounded execution only after the team understands failure patterns, has tested controls, and can detect when conditions have changed.

Expansion should be specific. Strong performance in one workflow does not justify broader access, a new audience, a larger financial limit, or a different kind of consequence. Each new grant of authority needs its own owner, rationale, evaluation, and revocation condition.

Just as importantly, authority must be able to contract. Source quality deteriorates. Policies change. Integrations fail. Attack patterns evolve. A mature system can return to draft-only mode, narrow its scope, or stop acting without requiring a crisis to prove the need.

09

Accountability stays with the organization

An AI system cannot absorb responsibility from the leaders who selected it, connected it, set its permissions, approved its use, and benefited from its speed. Calling the action autonomous does not make the consequence ownerless.

Every production AI capability should have a named owner for the business outcome, a named owner for the technical system, clear authority boundaries, an escalation path, and a recurring decision about whether the delegation remains justified. Vendors and implementation partners may contribute expertise, but they cannot hold the organization's accountability on its behalf.

The executive question is not how much autonomy the technology can demonstrate. It is how much authority the organization can responsibly delegate while preserving evidence, intervention, recovery, and human ownership.

AI capability is not AI authority. The organizations that understand the difference will move faster where the evidence supports action—and stop more intelligently where it does not.

About the author

James Cook

James is a technology strategist and architect who helps organizations build, modernize, and manage websites, applications, and the systems behind them.

More about James

Continue reading

01

AI governance

A human in the loop is not automatically a control.

Read the essay
02

Responsible AI

Trustworthy AI shows its work.

Read the essay
03

AI delivery

A boring AI launch can be a sign of serious leadership.

Read the essay

What comes next

What are you trying to build, fix, or change?

Bring the context. We will make the next step clear.

Schedule a consultation

An honest conversation makes the next step clear.

Tell me what you are trying to build, fix, or change. We will use 30 minutes to understand the need, clarify how I can help, and agree on what comes next.

Free 30-minute initial consultation · Remote nationwide