Read evidence, receipts and driftLesson 4 of 6
Investigate a stale result
Find the changed dependency and select the owning rerun rather than an older success.
What you'll do
Investigate a synthetic stale qualification and propose the smallest complete rerun. You will follow an observed dependency change and distinguish staleness from a new failing comparison. Use a worksheet with fictional bindings; no client evidence or live platform access is needed.
Read stale as a binding problem
A stale result has lost its current evidence binding after an observed input, output/version or upstream dependency change. It may describe a historically successful observation, but it no longer supports the same current claim. Do not read stale as "probably still fine."
The local ledger does not continuously poll every remote dependency. A green result records what was established using captured observations. Its age and the absence of a newly observed change do not prove that nothing remote has changed. Reobserve through the owning workflow when current evidence is required.
| Finding | Meaning | Next question |
|---|---|---|
| Input definition changed | Old actual used another definition | Which consumers depend on it? |
| Retained output changed | Bound bytes no longer match | Can original evidence be recovered honestly? |
| Newest retry failed | Current selected observation did not pass | What mismatch or evidence gap remains? |
| No observation exists | Qualification not established | Which producer must observe it? |
Trace the first changed dependency
Suppose a synthetic Sales contract changes its treatment of returns. The earlier Gold reconciliation used the old definition. Semantic and report checks that depend on that observation cannot automatically remain current. Begin at the changed definition, then trace the affected downstream chain.
Observed change: returns population definition
Affected evidence: Gold reconciliation
Dependent evidence: semantic query, report query, selected gate
Next action: review the definition and obtain current observations
Do not: select yesterday's green gate as today's resultRecord the changed file or asset, its observation and the selected receipt chain. Avoid guessing that a model refresh alone repairs the issue. A refresh can load data without validating the revised business population or the independent expectation.
Respect supersession
The newest failed retry supersedes an older success. This prevents an operator from presenting the most reassuring historical receipt while hiding the current failure. Preserve both: the old pass describes history; the new failure describes the selected retry and its reason.
A failed retry may reveal a numerical mismatch or missing evidence. Read the reason before choosing a remedy. Missing service export evidence is not repaired by changing a Gold measure, while a wrong join is not repaired by capturing another screenshot of the same wrong result.
Plan a complete, bounded rerun
List the dependency that changed and every required downstream observation it invalidates. Reuse evidence only where its bindings remain valid under the selected scope. The smallest complete rerun may be narrower than the whole pipeline, but it must include the dependent gate and any required rendered state.
If the business definition intentionally changes, identify the human review and expectation-version work first. If the definition is unchanged but a deployment drifted, use the approved deployment/read-back and observation workflow. Avoid inventing a replacement subject or claiming a historical signature authenticates newly edited bytes.
For the exercise, write a reviewer note with four sentences: the previous claim, the observed change, the current limitation and the next evidence required. Explain which operations need new consent and which are local inspection. Your expected output is this recommendation, not a fabricated repaired proof.
Conclude with a bounded status such as "The prior Sales report claim is stale after the observed model change; current query and rendered-state evidence remain pending." That statement gives a team a usable decision without claiming continuous monitoring, future correctness or business acceptance.
Check your understanding
- Why does an old passing result remain historical after a dependency changes?
- How does a newest failed retry affect an earlier success?
- Which evidence must be rerun after your synthetic definition change, and why?