Independent learning for embedded-systems engineersHardware · Firmware · Software
TEA-205LEARNING BY ROLEVERIFICATION

Verification and test engineers

Create trustworthy evidence by challenging requirements, controlling test conditions and observing the complete embedded system under normal and adverse operation.

After this module, you should be able to:

  • Translate requirements into objective verification methods
  • Select the right test level and representative environment
  • Design reproducible automation and traceable results
  • Investigate failures without weakening independence
01 / PURPOSE

Verification asks whether the claim is supported.

Embedded-system testing must control software identity, hardware revision, fixtures, instruments, calibration, stimuli, timing and environment. The role does more than execute procedures: it exposes ambiguity, improves observability and designs evidence that another competent person can reproduce.

CLAIMDefine pass criteriaRequirement, assumptions and coverage
METHODControl conditionsStimulus, oracle, equipment and uncertainty
RESULTPreserve evidenceConfiguration, observations and disposition
A passing test is only as strong as its oracle.Decide how the expected result is known and whether the test can detect a wrong internal state hidden behind a plausible output.
02 / RESPONSIBILITIES

Build a verification strategy, not a pile of tests.

AreaQuestionEvidence
Method selectionIs test, analysis, inspection or demonstration most credible?Verification plan and rationale
Test levelWhich claims belong at unit, integration, bench or system level?Coverage map
EnvironmentWhich loads, interfaces, timing and physical conditions matter?Facility and fixture specification
ObservabilityHow will state, timing and physical outcomes be measured?Instrumentation design
Result integrityCan the exact configuration and raw result be recovered?Immutable result package

Use automation to increase control

Automation should identify the unit under test, configure equipment, check prerequisites, timestamp raw observations, evaluate explicit criteria and preserve logs. A fast script that hides configuration is not reliable evidence.

03 / PRACTICE

Design tests from risks and boundaries.

  1. Review testability early. Challenge ambiguous, compound or unobservable requirements.
  2. Partition coverage. Put each claim at the lowest credible level, then retain system confirmation.
  3. Define the oracle. State expected outputs, timing, tolerances and allowed transients.
  4. Control the setup. Record versions, calibration, topology and environmental conditions.
  5. Exercise faults and edges. Include limits, transitions, overload and corrupted inputs.
  6. Triage without erasing history. Preserve failing evidence and link reruns to the correction.

Worked hand-off: sensor timeout

The requirement defines maximum detection and safe-state times. The test fixture stops sensor traffic at controlled phases, measures output disable independently and captures internal events. Runs cover start-up, steady state and recovery. Results bind the firmware build, board revision, fixture version and raw timing traces.

04 / EVIDENCE

Make the result reviewable and repeatable.

Verification plan

Scope, methods, levels, responsibilities and independence.

Controlled procedure

Setup, preconditions, stimuli, observations and criteria.

Configuration record

Hardware, software, tools, fixtures and calibration.

Raw observations

Logs, traces, captures and environmental measurements.

Evaluated result

Pass, fail or anomaly against a cited criterion.

Coverage status

Requirements, risks and unresolved gaps.

Common traps

Procedure equals requirement

The test repeats wording without defining measurable criteria.

Perfect simulator

The environment omits latency, loading and electrical faults.

Flaky acceptance

Reruns replace investigation of intermittent failures.

Lost provenance

A result cannot identify the tested binary or board.

05 / REFERENCES

Further learning

KEY TAKEAWAY

Test the claim, control the context.

Credible verification combines an observable requirement, a representative method, controlled configuration and evidence that survives independent review.