Mary Fung
noteJune 26, 2026

What is context?

Most AI failures are blamed on the model. Many are actually context failures.

Most AI failures are blamed on the model.

Many are actually context failures.

The AI was asked to do work without knowing the goal, the audience, the constraints, the examples, the source material, or what "good" looks like.

Then people are surprised when the answer is generic.

Context is what the AI knows before it starts working.

That can include the task, the intended reader, the company background, the relevant documents, the definitions, the tone, the rules, the examples, the decision criteria, and the things the model should avoid.

In plain English:

Context is the difference between "write something about this" and "help this specific person make this specific decision under these specific constraints."

Why context changes output

Imagine asking a smart employee to draft a board memo with no background.

You do not tell them the audience. You do not tell them the decision. You do not tell them what has already been tried. You do not tell them the politics, the budget, the risk, or the standard for approval.

The employee might still produce something polished.

It probably will not be useful.

AI has the same problem, just faster.

If the model lacks context, it fills the gap with general patterns. That is why so much AI output sounds plausible and empty. It is not always because the model is bad. Sometimes the request was under-specified.

Data is not the same as context

One common mistake is assuming that more data automatically means better context.

It does not.

A 60-page document dump may contain the answer. It may also bury the answer under irrelevant material.

Useful context is selected, structured, and connected to the job.

For example, if the AI is helping draft a customer response, it may need:

It probably does not need every historical email thread, every policy page, and every note from every meeting.

More is not always better. Better is better.

Context is where enterprise AI gets serious

Consumer AI often works with simple prompts because the stakes are low. If you ask for dinner ideas and one suggestion is bad, nothing breaks.

Enterprise AI is different.

The model needs to understand roles, approvals, systems, data definitions, customer commitments, legal boundaries, and operational reality.

That is why serious AI work quickly becomes context work.

Where does the model get approved information? Who maintains it? How does it know which source is current? What should it do when sources conflict? Who owns the answer? What should be logged?

These are not side questions.

They are the product.

A useful leader question

When a team shows an AI demo, ask:

What did the model know before it produced this answer?

That one question reveals a lot.

If the answer is "we just prompted it," the workflow may be fragile.

If the answer includes approved sources, examples, decision rules, evaluation criteria, and a review step, the team is probably thinking more seriously.

The goal is not to make prompts longer.

The goal is to make the work clearer.

What leaders should ask

Before trusting an AI workflow, ask:

The companies that get value from AI will not just have better prompts.

They will have better context: cleaner instructions, better source material, clearer review points, and a sharper definition of what good work looks like.

← back to the field