Focused Guide

What Useful Evidence Changes

2 minute read

You might be looking at the same screen and asking a different question: what makes this information evidence rather than a comforting signal? The answer is in what it can update. Evidence bears on a specific question and can update a belief, choice, or next action even when the answer is unwelcome.

Tie information to a live question

Evidence is not a glow of confirmation. It is information that would change something you do. The anchor is a named decision. When you can say, “If X happens, I will do A; if Y happens, I will do B,” you have turned vague checking into a test that can be passed or failed. The outcome may be pleasant or not, but either way it moves you.

Example: deciding whether to keep a pilot running

Imagine you are running a four-week pilot for a new sign-up flow. Week two just ended. The live question is whether to continue to week three as planned. You name the decision and the updating conditions before you look. For instance: “If completion rate this week is within two points of the control or better, we keep going. If it is five points worse or the error rate spikes above a set level, we pause and fix.”

Now you open the data. If the numbers land in the pause range, you pause. That is evidence, even though it is unwelcome. If the numbers land in the continue range, you continue; that is evidence too. Notice what did not guide the choice: a colleague saying it looks promising, a chart that stays green by design, or the relief you feel when the curve tilts up for a day. They are pleasant signals, but they did not update the action.

Signals that soothe vs information that updates

Comforting signals are fine to enjoy, but they do not have to carry weight they cannot bear. Common soothers include:

• A quick “LGTM” without criteria.
• A single day’s uptick after a dip.
• A dashboard badge that stays green by design.

None of these is wrong to notice. They simply do not answer the named question unless tied to a threshold that changes the decision.

Your call, named by the decision

You choose which question is live and what would honestly change your next step. Once named, you can let that information carry the weight, even if it sends you toward work you would rather avoid. You can still appreciate encouraging signs. You are no longer asking them to decide for you.