Lab 1 — Prompt and Verification
Lab 1 — Prompt and Verification
Key jargon
| Term | Plain-language meaning |
|---|---|
| Hypothesis | A testable expectation about how a prompt change will affect results. |
| Test case | One defined input with expected properties or outcome. |
| Control prompt | The unchanged baseline used for comparison. |
| Failure taxonomy | Named categories used to classify observed errors. |
Key concepts
- Change one prompt element at a time and compare against a stable baseline.
- Record inputs, model/version, settings, output, evidence, and failure labels so results can be reproduced.
Concept map
flowchart LR
A["Define hypothesis and cases"] --> B["Run baseline and variant"]
B --> C["Verify claims and classify failures"]
C --> D["Write evidence-backed conclusion"]Goal
Produce a one-page comparison using three supplied authoritative sources and demonstrate which source supports each material claim.
Steps
- Define audience, decision, scope, date, and output contract.
- Supply three short documents plus source metadata.
- Require claim-level citations and explicit unknowns.
- Run three times; record model/version/settings.
- Open every citation and label support as full, partial, or absent.
- Revise the prompt once and compare failure classes.
Pass criteria
- All material factual claims have direct support.
- Conflicting evidence remains visible.
- No invented source or unavailable fact.
- Output format is stable enough for the user.
Artifacts
Task contract, source manifest, prompt versions, outputs, claim audit, decision, and lessons learned.