§0.3
How Data Is Used
Data creates value only when it changes a workflow. A dashboard no one reviews is a report, not a management system. A prediction score that triggers no action is a number, not intelligence. A recommendation system that cannot learn from exposure and feedback is guesswork with software around it. A language model that summarizes documents without evaluation is convenience without control. The practical question is always the same: what job is the data doing?
The executive question: what decision workflow will this evidence improve?
Modern data use falls into a small number of recurring workflow families. The names change by industry, but the managerial logic is stable.
Some workflows monitor the business: revenue, margin, churn, conversion, service time, stockouts, quality, risk. Some diagnose where a metric moved: by customer segment, geography, product, cohort, channel, store, or time period. Some learn causally: did a price change, campaign, policy, or process change cause an outcome? Some predict: which customers will churn, which orders are risky, how much demand should we expect? Some rank and recommend: what should be shown first, who should be contacted first, which action should be suggested next? Some read unstructured work: tickets, calls, documents, images, contracts, resumes, invoices, policy manuals. Some optimize a constrained action: staffing, inventory, routing, pricing, media spend, assortment, or scheduling.
Use-case router: business question to evidence workflow
The same source data can support several workflows. The manager's first job is to route the question before choosing the method.
Figure 1 is one of the book's central habits. Before debating tools, route the question.
Monitoring: what is happening?
Monitoring is the most familiar use of data. The firm defines metrics, refreshes them on a cadence, and watches for movement. KPI dashboards, scorecards, alerts, and operating reviews all live here.
Monitoring is useful when:
- the metric is clearly defined;
- the owner knows what action they can take;
- the refresh cadence matches the action cadence;
- the dashboard separates normal variation from signals that require attention;
- the view supports drilldown when a metric moves.
Monitoring fails when the dashboard becomes a collection of charts without a decision path. A useful dashboard answers three questions in sequence: what moved, where did it move, and what should we inspect or do next?
Diagnosis: where, for whom, and why might it be happening?
Diagnosis starts after monitoring notices movement. If weekly margin falls, the manager needs to know whether the issue is a product, store, region, customer segment, campaign, channel, or supply problem. This is where segmentation, cohorts, funnels, small multiples, maps, and drilldowns matter.
Diagnosis does not prove causality. It narrows the search. It tells the team where to investigate and what comparison might be useful.
| Stage | Question | Default evidence | Common failure |
|---|---|---|---|
| Monitor | What changed? | KPI trend, alert, scorecard | No action owner or threshold |
| Diagnose | Where did it change? | Segment drilldown, cohort, small multiples | Treating a pattern as proof of cause |
| Decide | What should we do? | Decision brief, experiment, model, memo | Jumping from dashboard to action without comparison |
Strategic decisions: where should the firm place its bets?
Strategy uses data differently from daily operations. The evidence is often less fresh, more aggregated, and more uncertain. Market expansion, pricing architecture, product portfolio, customer segment focus, channel strategy, capacity investment, and acquisition screening all require a blend of historical data, external context, assumptions, and judgment.
The practical discipline is to separate three things:
- Facts from the current business. What do our customers, products, stores, channels, and margins show?
- Assumptions about the future. What must be true for the strategy to work?
- Tests and signals. What data would tell us early that the strategy is working or failing?
This is why the book returns to decision memos. Strategic decisions need evidence, but they also need an explicit threshold for acting and a plan for learning after action.
Causal learning: did the action work?
Many business questions are causal: did the email cause incremental sales, did the discount lift profit, did the new onboarding flow reduce churn, did the policy change reduce risk? Historical data alone often makes these questions look easier than they are.
The key issue is the counterfactual: what would have happened without the action? Experiments, A/B tests, difference-in-differences, synthetic control, regression with credible identification, and other designs are ways of constructing a comparison that earns the word "caused."
Causal learning is not always required. If the question is only "which stores are currently above target?", a dashboard is enough. If the question is "should we roll out this promotion nationally?", a dashboard is not enough.
Prediction, ranking, and recommendation
Prediction asks what is likely to happen next. Churn models, demand forecasts, fraud scores, lead scores, risk models, and delivery-time predictions all live here. The model does not need to know what caused the outcome to be useful, but it does need a clear action attached to the score.
Ranking and recommendation go one step further. They order choices: which product to show, which customer to contact, which ticket to escalate, which loan to review, which store to visit, which document to retrieve. Ranking systems need extra care because they shape the future data they observe. If a product is never shown, the system cannot learn whether customers would have liked it.
Generative AI and unstructured workflows
Many modern workflows use data that does not look like rows and columns: support tickets, product reviews, policy documents, sales calls, PDFs, images, screenshots, contracts, invoices, code, slides, and emails. AI workflows help classify, extract, summarize, retrieve, draft, route, and monitor this work.
The mature version is not "ask the model." It is a designed workflow:
- collect the source material;
- retrieve or select relevant context;
- ask the model for a bounded task;
- require structured output when the result must feed another system;
- evaluate accuracy, grounding, bias, privacy, and refusal behavior;
- route uncertain or high-risk cases to human review;
- monitor the workflow after deployment.
AI is powerful because it makes language, documents, and images operational. It is risky for the same reason: it can make weak evidence look fluent.
Optimization: what should we do under constraints?
Optimization turns predictions, rules, and business constraints into an action plan. How many employees should be scheduled? Which stores should receive inventory? How should delivery routes be assigned? Which media channels should receive budget? Which price should be offered under margin and fairness constraints?
Optimization is often where analytics becomes real. It also exposes hidden objectives. Are we optimizing revenue, margin, customer satisfaction, utilization, fairness, retention, or risk? If the objective is wrong, the optimized answer is wrong with confidence.
Concept check
Three routing questions. Pick the workflow before picking the method.
- 1.A dashboard shows that Southeast revenue fell last week. The team wants to know whether the decline came from a specific product family, store type, or customer segment. What workflow is this?
- 2.A churn model ranks customers by risk, but no retention team owns the action attached to the score. What is missing?
- 3.A support AI summarizes policy documents for agents. The key managerial concern is: