Skip to content

Engineering Stage

ES-109 — Testing and Verification

Verify that integrated implementation satisfies requirements, preserves guardrails, handles failure paths, and produces trustworthy evidence.

Verification and Release Preparation Testing Evidence Next: ES-110

ES-109 Activities

Purpose

This page guides testing and verification work for ES-109.

Complete these activities for each integrated baseline or release candidate. Iterate when test results reveal defects, gaps, or unverified guardrails.

Activity 1 — Define test strategy

Create:

docs/testing/test_strategy.md

Use:

template-library/testing/test_strategy.md

Define testing scope, verification priorities, test levels, guardrail focus, AI verification position, and known risks.

Evidence Produced

Testing strategy evidence.

Activity 2 — Create test plan

Create:

docs/testing/test_plan.md

Use:

template-library/testing/test_plan.md

Define what will be tested, who owns testing, when it occurs, and what evidence is expected.

Evidence Produced

Testing plan evidence.

Activity 3 — Define test cases

Create:

docs/testing/test_cases.md

Use:

template-library/testing/test_cases.md

Define functional, non-functional, guardrail, failure-path, AI-boundary, and regression test cases.

Evidence Produced

Test case evidence.

Activity 4 — Build verification matrix

Create:

docs/testing/verification_matrix.md

Use:

template-library/testing/verification_matrix.md

Map requirements, guardrails, risks, and findings to verification evidence.

Evidence Produced

Verification traceability evidence.

Activity 5 — Execute tests and record results

Create or update:

docs/testing/test_execution_record.md

Use:

template-library/testing/test_execution_record.md

Record test execution, results, evidence, failures, and retest status.

Evidence Produced

Test execution evidence.

Activity 6 — Maintain defect log

Create or update:

docs/testing/defect_log.md

Use:

template-library/testing/defect_log.md

Record defects, severity, source, owner, resolution, retest result, and remaining risk.

Evidence Produced

Defect evidence.

Activity 7 — Verify guardrails

Create or update:

docs/testing/guardrail_verification.md

Use:

template-library/testing/guardrail_verification.md

Verify high-priority guardrails directly.

Evidence Produced

Guardrail verification evidence.

Activity 8 — Verify AI behavior

Create or update:

docs/testing/ai_verification_record.md

Use:

template-library/testing/ai_verification_record.md

If AI is not used, state not applicable and confirm no AI path exists. If AI is used, verify AI-control boundaries.

Evidence Produced

AI verification evidence.

Activity 9 — Run regression checks

Create or update:

docs/testing/regression_check_record.md

Use:

template-library/testing/regression_check_record.md

Record regression checks for core behavior and guardrails after integration.

Evidence Produced

Regression evidence.

Activity 10 — Complete testing readiness summary

Create:

docs/testing/testing_readiness_summary.md

Use:

template-library/testing/testing_readiness_summary.md

Summarize readiness for ES-110.

Evidence Produced

Transition evidence from testing to release readiness.

test_strategy.md
  ↓
test_plan.md
  ↓
test_cases.md
  ↓
verification_matrix.md
  ↓
test_execution_record.md
  ↓
defect_log.md
  ↓
guardrail_verification.md
  ↓
ai_verification_record.md
  ↓
regression_check_record.md
  ↓
testing_readiness_summary.md
AI Assistance

AI may suggest failure-path tests, map requirements to missing test cases, review the verification matrix for gaps, and identify guardrail-sensitive behavior not covered by tests. Engineers decide adequacy.

Common Pitfall

Do not skip defect logging for issues fixed quickly. Fast fixes still leave useful evidence.

Continue to Evidence

Review what counts as sufficient testing and verification evidence.

Continue to Evidence →