Reporting and decisions
The Report Arrived. Why Is Everyone Rebuilding It?
AI can help turn data from existing systems into a useful report, provided you define the decision, the underlying calculations, and the output people actually need. A polished summary adds little if its recipient must rebuild a spreadsheet before taking action.
Watch what happens after delivery
A report can arrive on time, contain accurate information, and still miss its purpose. The operations lead copies its rows into a worksheet. A manager adds owners and due dates. A client asks which items require a response. Those extra steps show what the report should have included.
In an AIify It reporting discussion, a recipient said the organization of an existing email output was helpful. They had then assembled a spreadsheet with additional information from the same underlying source and requested that format as part of the recurring output.
The requested enhancement was still a request in that discussion. The recipient also said business results were not yet known. The lesson is about discovering a useful format from actual use, rather than assuming that successful delivery proves the report is doing its job.
Choose one decision and one reader
Before connecting data sources, finish this sentence: “When this person reads the report, they need to decide or do this.” A staffing decision, a client update, and a list of overdue actions call for different levels of detail.
For an illustrative service-operations report, a manager might need to decide which unfinished jobs require intervention. The useful output could include the blocked job, the reason, its owner, and the next action. A narrative about overall activity would not give that manager enough to work with.
If several groups need different views, agree which information they share and which details belong only in each audience’s version. Be especially careful with client-facing reports: an internal explanation or another client’s record should never be included merely because it appeared in the source data.
Settle definitions before writing summaries
List the fields and measures the report needs, then decide where each comes from. An open item might mean “not marked complete” in one system and “still awaiting acceptance” in another. Pick the meaning that supports the decision and document how conflicting states are handled.
Agree the reporting period, cutoff time, timezone, and treatment of late changes. State whether a total counts records, unique customers, or completed actions. Decide what happens when an identifier is missing or the same event appears in more than one source.
Calculate important totals through explicit, inspectable rules. Give the language model those verified results when asking it to write a summary. Require the report to distinguish missing information from a confirmed zero; the reader should not have to guess whether a quiet period was actually checked.
Give the summary a working companion
A short summary can explain what changed and what deserves attention. A detailed worksheet can let people filter, assign, investigate, and follow through. Use both when the reader needs both, without turning every report into a large dashboard project.
Choose columns with a real recipient and a representative sample. Ask them to complete their usual task using it. If they immediately add a column, that is useful design feedback. If they delete most columns, reduce the output.
For an action-oriented report, consider the following fields:
- The item or issue, described in language the recipient uses.
- The current status and the relevant reporting period.
- The source reference, accessible to that recipient.
- The person responsible for the next action.
- The next action and its due date, where one has been agreed.
- A clear note when information is missing, disputed, or awaiting confirmation.
Keep explanations tied to evidence
Give the summary a narrow job: describe the verified figures, highlight defined exceptions, and point to the supporting detail. Label interpretation as interpretation. If the data shows a backlog growing, the report should not invent a cause or attribute blame without supporting evidence.
Make it possible to trace an important sentence to the records or calculation behind it. The right source link or reference can be more useful than a longer explanation. Check that the intended audience has permission to open it.
If a source is unavailable or stale, show the coverage limit prominently. Decide whether to delay the report, publish a clearly partial version, or ask an owner to resolve the gap. Do not quietly reuse an older number under a new report date.
Choose the exceptions that must survive the summary
Chapters 10 and 12 of Stafford Beer’s Brain of the Firm examine how important signals can disappear through routine filtering. Our practical application is to agree which facts a report must preserve before asking AI to shorten it.
Define those facts with the reader: an overdue high-impact item, an unresolved conflict, missing source coverage or an explicit warning that changes the next decision. Produce a structured exception list from the permitted evidence and check that the summary remains consistent with it. Do not rely on the model to decide which rare event matters most.
Use a synthetic acceptance test containing many routine completed jobs and one blocked job whose delivery decision is still urgent. Shorten the requested summary and vary the position of the blocked item in the input. The owner, unresolved condition and required decision should remain visible in the delivered view. Reassuring prose that hides the item fails the test, even if the routine totals are correct.
Keep the exception view within the audience’s permissions. An important warning needs a route to someone authorized to act; its importance does not justify exposing restricted supporting records to every report recipient.
Check whether the report gets used
Compare the first outputs with the established reporting process. Reconcile key totals and ask the recipient to walk through a decision using the report. Look for omitted items, confusing definitions, unexpected exposure, and manual reconstruction.
For a proportionate independent check, sample source items through an authorized read path separate from the report’s selection and summarization steps. Include something the report omitted and something it marked complete, then compare their actual state with the delivered view. Chapter 12 of Beer’s book motivates this additional audit perspective. Asking the same model to reread the same filtered extract may repeat the same omission; a small sample also cannot establish an overall accuracy rate.
Agree how corrections will be handled after delivery. Recipients need to know which version is current and whether a changed figure affects an action they already took. An archive of reports is more useful when its period and version are unambiguous.
Measure the effort required to prepare and use the report, alongside corrections and unresolved questions. That gives you a basis for judging value without claiming that every report automatically produces revenue or savings. A good first milestone is a report the recipient can use as delivered.