James CookTechnology Strategist & Architect
All insights

AI readiness

Prompt tuning cannot repair a broken policy.

When an AI failure exposes conflicting source material or ambiguous decisions, the organization must improve the underlying knowledge.

A torn sheet of white paper taped back together.
Field note 36 · AI readiness · Photo by Olga Thelavart on Unsplash

A prompt cannot resolve a contradiction the organization itself has never decided.

01

The convenient technical response

When an AI answer is wrong, teams inspect the prompt, retrieval settings, and model behavior. Those are appropriate places to look.

But if two approved documents conflict, a record lacks required context, or policy has no owner, the system cannot infer a responsible truth through wording alone.

02

Classify the failure correctly

Separate model failures from retrieval failures, source failures, policy failures, and workflow failures. Each class has a different owner and remedy.

This prevents engineering from repeatedly compensating for organizational ambiguity and gives leaders evidence about where the operating system needs repair.

Do not ask the model to hide a governance problem behind better language.
03

Create a knowledge correction loop

Route source conflicts and missing rules to accountable owners. Record the resolution, effective date, affected content, and need for re-evaluation.

The AI product becomes a sensor for knowledge quality. Its failures can improve the organization if the operating model allows them to reach the right decision maker.

04

Fix the truth before the phrasing

Prompt improvements can clarify behavior, enforce format, and reduce known error patterns. They should not be used to manufacture confidence from unresolved evidence.

Prompt tuning cannot repair a broken policy. Improve the underlying decision, then teach the system how to represent it.

About the author

James Cook

James is a technology strategist and architect who helps organizations build, modernize, and manage websites, applications, and the systems behind them.

More about James

Continue reading

01

AI governance

A human in the loop is not automatically a control.

Read the essay
02

Responsible AI

Trustworthy AI shows its work.

Read the essay
03

AI delivery

A boring AI launch can be a sign of serious leadership.

Read the essay

What comes next

What are you trying to build, fix, or change?

Bring the context. We will make the next step clear.

Schedule a consultation

An honest conversation makes the next step clear.

Tell me what you are trying to build, fix, or change. We will use 30 minutes to understand the need, clarify how I can help, and agree on what comes next.

Free 30-minute initial consultation · Remote nationwide